Max level shown:
12025-01-22T05:15:00.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = d6618536-3df6-4a1c-9781-bad7b191b736 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
22025-01-22T05:15:00.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = d6618536-3df6-4a1c-9781-bad7b191b736 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
32025-01-22T05:15:00.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = d6618536-3df6-4a1c-9781-bad7b191b736 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
42025-01-22T05:15:00.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = ec770a46-9a0a-49d7-a0ce-a64347b995af roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
52025-01-22T05:15:00.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = ec770a46-9a0a-49d7-a0ce-a64347b995af resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
62025-01-22T05:15:00.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = ec770a46-9a0a-49d7-a0ce-a64347b995af response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
72025-01-22T05:15:01.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5ff16df-a5a8-4d2b-81eb-61f9a7ffa03b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82025-01-22T05:15:01.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5ff16df-a5a8-4d2b-81eb-61f9a7ffa03b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
92025-01-22T05:15:01.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5ff16df-a5a8-4d2b-81eb-61f9a7ffa03b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
102025-01-22T05:15:02.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f115b31f-a5d3-48ab-a565-ce2afe2131f7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
112025-01-22T05:15:02.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f115b31f-a5d3-48ab-a565-ce2afe2131f7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
122025-01-22T05:15:02.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f115b31f-a5d3-48ab-a565-ce2afe2131f7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
132025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
142025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
152025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
162025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
172025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
182025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
192025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
202025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
212025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
222025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
232025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
242025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
252025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
262025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
272025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
282025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
292025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
302025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
312025-01-22T05:15:02.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
322025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
332025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
342025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
362025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
372025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
382025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
392025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
402025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
412025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
422025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
432025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
442025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
452025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
462025-01-22T05:15:02.821ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
472025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
482025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
492025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
502025-01-22T05:15:02.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
512025-01-22T05:15:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
522025-01-22T05:15:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
532025-01-22T05:15:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
542025-01-22T05:15:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
552025-01-22T05:15:02.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
562025-01-22T05:15:02.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
572025-01-22T05:15:02.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
582025-01-22T05:15:02.824ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.881599ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
592025-01-22T05:15:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
602025-01-22T05:15:02.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
612025-01-22T05:15:02.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
622025-01-22T05:15:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
632025-01-22T05:15:02.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11085, tv_nsec: 176520271 } })
642025-01-22T05:15:02.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
652025-01-22T05:15:02.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
662025-01-22T05:15:02.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
672025-01-22T05:15:02.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
682025-01-22T05:15:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
692025-01-22T05:15:02.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
702025-01-22T05:15:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
712025-01-22T05:15:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
722025-01-22T05:15:02.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
732025-01-22T05:15:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
742025-01-22T05:15:02.829ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
752025-01-22T05:15:02.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11085, tv_nsec: 181185516 } })
762025-01-22T05:15:02.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
772025-01-22T05:15:02.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
782025-01-22T05:15:02.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
792025-01-22T05:15:02.832ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
802025-01-22T05:15:02.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
812025-01-22T05:15:02.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
822025-01-22T05:15:02.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
832025-01-22T05:15:02.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
842025-01-22T05:15:02.834ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
852025-01-22T05:15:02.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
862025-01-22T05:15:02.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
872025-01-22T05:15:02.835ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11085, tv_nsec: 185847541 } })
882025-01-22T05:15:02.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
892025-01-22T05:15:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
902025-01-22T05:15:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
912025-01-22T05:15:02.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
922025-01-22T05:15:02.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
932025-01-22T05:15:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
942025-01-22T05:15:02.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
952025-01-22T05:15:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
962025-01-22T05:15:02.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
972025-01-22T05:15:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
982025-01-22T05:15:02.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
992025-01-22T05:15:02.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 17.67519ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1002025-01-22T05:15:02.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1012025-01-22T05:15:02.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1022025-01-22T05:15:02.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1032025-01-22T05:15:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1042025-01-22T05:15:02.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1052025-01-22T05:15:02.842ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
1062025-01-22T05:15:02.842ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
1072025-01-22T05:15:02.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1082025-01-22T05:15:02.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1092025-01-22T05:15:02.842ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
1102025-01-22T05:15:02.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1112025-01-22T05:15:02.842ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
1122025-01-22T05:15:02.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1132025-01-22T05:15:02.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1142025-01-22T05:15:02.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1152025-01-22T05:15:02.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1162025-01-22T05:15:02.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1172025-01-22T05:15:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
1182025-01-22T05:15:02.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1192025-01-22T05:15:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1202025-01-22T05:15:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1212025-01-22T05:15:02.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1222025-01-22T05:15:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1232025-01-22T05:15:02.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.445182ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
1242025-01-22T05:15:02.860ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 40.199039ms iteration = 12 status = {"physical_disks_added":0}
1252025-01-22T05:15:02.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
1262025-01-22T05:15:02.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.986228ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
1272025-01-22T05:15:02.877ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1282025-01-22T05:15:02.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1292025-01-22T05:15:02.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.87355ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1302025-01-22T05:15:02.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1312025-01-22T05:15:02.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1322025-01-22T05:15:02.886ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1332025-01-22T05:15:02.886ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1342025-01-22T05:15:02.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1352025-01-22T05:15:02.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1362025-01-22T05:15:02.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1372025-01-22T05:15:02.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1382025-01-22T05:15:02.889ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1392025-01-22T05:15:02.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1402025-01-22T05:15:02.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1412025-01-22T05:15:02.891ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1422025-01-22T05:15:02.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
1432025-01-22T05:15:02.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1442025-01-22T05:15:02.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1452025-01-22T05:15:02.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1462025-01-22T05:15:02.894ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1472025-01-22T05:15:02.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1482025-01-22T05:15:02.894ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1492025-01-22T05:15:02.894ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.524878ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1502025-01-22T05:15:02.895ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.15122ms iteration = 10 status = 0
1512025-01-22T05:15:02.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1522025-01-22T05:15:02.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1532025-01-22T05:15:02.906ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1542025-01-22T05:15:02.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1552025-01-22T05:15:02.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.035045ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
1562025-01-22T05:15:02.927ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1572025-01-22T05:15:02.927ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1582025-01-22T05:15:02.927ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1592025-01-22T05:15:02.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1602025-01-22T05:15:02.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
1612025-01-22T05:15:02.928ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1622025-01-22T05:15:02.928ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e471a385-829f-4c3d-b819-b047129082ee", "content-length": "26", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
1632025-01-22T05:15:02.928ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1642025-01-22T05:15:02.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1652025-01-22T05:15:02.936ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
1662025-01-22T05:15:02.936ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1672025-01-22T05:15:02.937ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "039b70d2-0d16-4cee-b268-d9d181f0cc86", "content-length": "26", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
1682025-01-22T05:15:02.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1692025-01-22T05:15:02.939ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
1702025-01-22T05:15:02.939ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1712025-01-22T05:15:02.939ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5519465-af6a-47bf-9e42-52c3fadaae6d", "content-length": "26", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
1722025-01-22T05:15:02.939ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1732025-01-22T05:15:02.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.421255ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1742025-01-22T05:15:02.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
1752025-01-22T05:15:02.940ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
1762025-01-22T05:15:02.940ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 120.178248ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
1772025-01-22T05:15:02.941ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1782025-01-22T05:15:02.953ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1792025-01-22T05:15:02.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1802025-01-22T05:15:02.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1812025-01-22T05:15:02.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1822025-01-22T05:15:02.978ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1832025-01-22T05:15:02.978ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1842025-01-22T05:15:02.978ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.58411ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1852025-01-22T05:15:02.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 151.440955ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
1862025-01-22T05:15:03.056ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.286893ms iteration = 10 status = {}
1872025-01-22T05:15:03.062ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1882025-01-22T05:15:03.062ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1892025-01-22T05:15:03.063ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "70aea5a9-5b31-4ad2-96cb-b47c54b1a9ac", "content-length": "372", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
1902025-01-22T05:15:03.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1912025-01-22T05:15:03.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1922025-01-22T05:15:03.083ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
1932025-01-22T05:15:03.083ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
1942025-01-22T05:15:03.083ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c00cf6e4-cd0a-464a-ae4c-a11e75a24e1b", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
1952025-01-22T05:15:03.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1962025-01-22T05:15:03.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1972025-01-22T05:15:03.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1982025-01-22T05:15:03.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1992025-01-22T05:15:03.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2002025-01-22T05:15:03.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2012025-01-22T05:15:03.094ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2022025-01-22T05:15:03.094ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2032025-01-22T05:15:03.097ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7d92111a-1686-4222-a602-6e3824c8102b", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
2042025-01-22T05:15:03.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2052025-01-22T05:15:03.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2062025-01-22T05:15:03.099ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 277.613825ms iteration = 10 status = {}
2072025-01-22T05:15:03.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2082025-01-22T05:15:03.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2092025-01-22T05:15:03.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2102025-01-22T05:15:03.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2112025-01-22T05:15:03.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2122025-01-22T05:15:03.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2132025-01-22T05:15:03.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2142025-01-22T05:15:03.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2152025-01-22T05:15:03.116ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2162025-01-22T05:15:03.116ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "379cbb96-64dd-4d16-96b3-4bd86701d772", "content-length": "1", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
2172025-01-22T05:15:03.117ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2182025-01-22T05:15:03.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2192025-01-22T05:15:03.121ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 300.320838ms iteration = 10 status = null
2202025-01-22T05:15:03.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2212025-01-22T05:15:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2222025-01-22T05:15:03.223ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
2232025-01-22T05:15:03.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2242025-01-22T05:15:03.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2252025-01-22T05:15:03.231ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2262025-01-22T05:15:03.231ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6571b39b-58d0-489f-bc91-e4da489b47c6", "content-length": "691", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
2272025-01-22T05:15:03.232ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
2282025-01-22T05:15:03.232ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2292025-01-22T05:15:03.232ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2302025-01-22T05:15:03.233ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 412.284208ms iteration = 10 status = {}
2312025-01-22T05:15:03.235ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2322025-01-22T05:15:03.235ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf221659-89a3-47a1-a995-7c99fb6fad23", "content-length": "134", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
2332025-01-22T05:15:03.235ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2342025-01-22T05:15:03.235ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
2352025-01-22T05:15:03.235ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2362025-01-22T05:15:03.235ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2372025-01-22T05:15:03.235ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2382025-01-22T05:15:03.235ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2392025-01-22T05:15:03.235ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2402025-01-22T05:15:03.235ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2412025-01-22T05:15:03.236ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2422025-01-22T05:15:03.236ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2432025-01-22T05:15:03.236ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
2442025-01-22T05:15:03.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2452025-01-22T05:15:03.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2462025-01-22T05:15:03.239ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2472025-01-22T05:15:03.239ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e04bca17-9689-41e7-9d90-32e9b944d612", "content-length": "2", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
2482025-01-22T05:15:03.239ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2492025-01-22T05:15:03.239ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "185aee39-a6a2-4c34-8efb-4da64b4e513e", "content-length": "51", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
2502025-01-22T05:15:03.239ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
2512025-01-22T05:15:03.239ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2522025-01-22T05:15:03.342ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8e0220a9-faec-4b34-900f-0c12291db8ac", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
2532025-01-22T05:15:03.342ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
2542025-01-22T05:15:03.342ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2552025-01-22T05:15:03.342ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1fffe36-65b5-4e1f-9b37-c258416f79c3", "content-length": "682", "date": "Wed, 22 Jan 2025 05:15:02 GMT"} })
2562025-01-22T05:15:03.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2572025-01-22T05:15:03.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2582025-01-22T05:15:03.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2592025-01-22T05:15:03.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2602025-01-22T05:15:03.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2612025-01-22T05:15:03.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2622025-01-22T05:15:03.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2632025-01-22T05:15:03.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2642025-01-22T05:15:03.359ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 538.409608ms iteration = 10 status = {}
2652025-01-22T05:15:03.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2f81dbf6-89ba-43a0-874d-3cb5978fc873 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2662025-01-22T05:15:03.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2f81dbf6-89ba-43a0-874d-3cb5978fc873 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2672025-01-22T05:15:03.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2f81dbf6-89ba-43a0-874d-3cb5978fc873 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2682025-01-22T05:15:04.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 753020e7-8ddd-4f67-a4c5-a4aaf05aeb0c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2692025-01-22T05:15:04.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 753020e7-8ddd-4f67-a4c5-a4aaf05aeb0c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2702025-01-22T05:15:04.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 753020e7-8ddd-4f67-a4c5-a4aaf05aeb0c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2712025-01-22T05:15:04.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5e9d9c06-70bc-447d-877a-51ae49526ea9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2722025-01-22T05:15:04.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5e9d9c06-70bc-447d-877a-51ae49526ea9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2732025-01-22T05:15:04.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5e9d9c06-70bc-447d-877a-51ae49526ea9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2742025-01-22T05:15:05.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0ec55909-0769-4d7a-93f3-a2bed839c5ac roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2752025-01-22T05:15:05.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0ec55909-0769-4d7a-93f3-a2bed839c5ac resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2762025-01-22T05:15:05.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0ec55909-0769-4d7a-93f3-a2bed839c5ac response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2772025-01-22T05:15:05.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 553 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = eabda8cf-3851-4b33-9307-c114ebeef6fe response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
2782025-01-22T05:15:06.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d5d2000-fa5d-45e0-b0f2-3e1ad06898f2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2792025-01-22T05:15:06.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d5d2000-fa5d-45e0-b0f2-3e1ad06898f2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2802025-01-22T05:15:06.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d5d2000-fa5d-45e0-b0f2-3e1ad06898f2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2812025-01-22T05:15:07.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f5bb2381-dfac-49db-86dd-5b1c5be9b442 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2822025-01-22T05:15:07.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f5bb2381-dfac-49db-86dd-5b1c5be9b442 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2832025-01-22T05:15:07.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f5bb2381-dfac-49db-86dd-5b1c5be9b442 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2842025-01-22T05:15:08.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb6fad69-ef33-49a5-8c6b-c603f1f4e8ab roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2852025-01-22T05:15:08.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb6fad69-ef33-49a5-8c6b-c603f1f4e8ab resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2862025-01-22T05:15:08.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb6fad69-ef33-49a5-8c6b-c603f1f4e8ab response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2872025-01-22T05:15:09.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3b5b8238-6c1f-4438-8325-8a54e01b496f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2882025-01-22T05:15:09.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3b5b8238-6c1f-4438-8325-8a54e01b496f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2892025-01-22T05:15:09.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3b5b8238-6c1f-4438-8325-8a54e01b496f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2902025-01-22T05:15:10.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 88172e26-2d88-4cb1-8c5e-4ffea1f6a48a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2912025-01-22T05:15:10.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 88172e26-2d88-4cb1-8c5e-4ffea1f6a48a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2922025-01-22T05:15:10.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 88172e26-2d88-4cb1-8c5e-4ffea1f6a48a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2932025-01-22T05:15:11.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 111770b3-d9e6-4e81-80b7-297b89caf79c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2942025-01-22T05:15:11.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 111770b3-d9e6-4e81-80b7-297b89caf79c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2952025-01-22T05:15:11.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 111770b3-d9e6-4e81-80b7-297b89caf79c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2962025-01-22T05:15:12.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3eaac728-0901-46e6-a48d-835c649af874 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2972025-01-22T05:15:12.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3eaac728-0901-46e6-a48d-835c649af874 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2982025-01-22T05:15:12.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3eaac728-0901-46e6-a48d-835c649af874 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
2992025-01-22T05:15:12.820ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
3002025-01-22T05:15:12.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3012025-01-22T05:15:12.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3022025-01-22T05:15:12.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
3032025-01-22T05:15:12.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3042025-01-22T05:15:12.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3052025-01-22T05:15:12.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3062025-01-22T05:15:12.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3072025-01-22T05:15:12.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3082025-01-22T05:15:12.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3092025-01-22T05:15:12.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3102025-01-22T05:15:12.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3112025-01-22T05:15:12.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3122025-01-22T05:15:12.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3132025-01-22T05:15:12.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3142025-01-22T05:15:12.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
3152025-01-22T05:15:12.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3162025-01-22T05:15:12.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3172025-01-22T05:15:12.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
3182025-01-22T05:15:12.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.302613ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
3192025-01-22T05:15:12.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.460711ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3202025-01-22T05:15:13.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4dd4a05f-b0af-4023-a8b0-64a00e25d9e8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3212025-01-22T05:15:13.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4dd4a05f-b0af-4023-a8b0-64a00e25d9e8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3222025-01-22T05:15:13.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4dd4a05f-b0af-4023-a8b0-64a00e25d9e8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3232025-01-22T05:15:14.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 57062b06-8b4e-4ef4-8498-aca2cf1557ce roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3242025-01-22T05:15:14.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 57062b06-8b4e-4ef4-8498-aca2cf1557ce resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3252025-01-22T05:15:14.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 57062b06-8b4e-4ef4-8498-aca2cf1557ce response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3262025-01-22T05:15:15.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 898e6722-709e-4947-9dd6-18b82b12bce5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3272025-01-22T05:15:15.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 898e6722-709e-4947-9dd6-18b82b12bce5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3282025-01-22T05:15:15.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 898e6722-709e-4947-9dd6-18b82b12bce5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3292025-01-22T05:15:15.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 7f8d80c3-f6f0-4efc-883b-b74541479129 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
3302025-01-22T05:15:16.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 47923f9b-0554-4e70-b35b-26aa12cdd928 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3312025-01-22T05:15:16.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 47923f9b-0554-4e70-b35b-26aa12cdd928 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3322025-01-22T05:15:16.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 47923f9b-0554-4e70-b35b-26aa12cdd928 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3332025-01-22T05:15:17.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fdec0014-684d-45cd-80a1-e43a0071c4c7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3342025-01-22T05:15:17.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fdec0014-684d-45cd-80a1-e43a0071c4c7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3352025-01-22T05:15:17.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fdec0014-684d-45cd-80a1-e43a0071c4c7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3362025-01-22T05:15:18.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a3c5ee2-f9ce-454c-a821-f72169918eaf roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3372025-01-22T05:15:18.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a3c5ee2-f9ce-454c-a821-f72169918eaf resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3382025-01-22T05:15:18.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a3c5ee2-f9ce-454c-a821-f72169918eaf response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3392025-01-22T05:15:19.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c9f5e48b-9096-4660-807f-716e143ac1f2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3402025-01-22T05:15:19.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c9f5e48b-9096-4660-807f-716e143ac1f2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3412025-01-22T05:15:19.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c9f5e48b-9096-4660-807f-716e143ac1f2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3422025-01-22T05:15:20.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3f611ddc-9b85-47e1-98b5-a5a5f7e13411 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3432025-01-22T05:15:20.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3f611ddc-9b85-47e1-98b5-a5a5f7e13411 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3442025-01-22T05:15:20.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3f611ddc-9b85-47e1-98b5-a5a5f7e13411 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3452025-01-22T05:15:21.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ad5ed480-7e8a-427a-b678-9f54cb7f02ed roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3462025-01-22T05:15:21.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ad5ed480-7e8a-427a-b678-9f54cb7f02ed resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3472025-01-22T05:15:21.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ad5ed480-7e8a-427a-b678-9f54cb7f02ed response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3482025-01-22T05:15:22.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
3492025-01-22T05:15:22.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3502025-01-22T05:15:22.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3512025-01-22T05:15:22.821ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
3522025-01-22T05:15:22.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3532025-01-22T05:15:22.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3542025-01-22T05:15:22.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3552025-01-22T05:15:22.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3562025-01-22T05:15:22.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3572025-01-22T05:15:22.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.984521ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3582025-01-22T05:15:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3592025-01-22T05:15:22.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3602025-01-22T05:15:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3612025-01-22T05:15:22.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3622025-01-22T05:15:22.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3632025-01-22T05:15:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3642025-01-22T05:15:22.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
3652025-01-22T05:15:22.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3662025-01-22T05:15:22.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3672025-01-22T05:15:22.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
3682025-01-22T05:15:22.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.807633ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
3692025-01-22T05:15:23.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c63d511d-6455-495c-ab3f-b3dd3e4ad491 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3702025-01-22T05:15:23.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c63d511d-6455-495c-ab3f-b3dd3e4ad491 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3712025-01-22T05:15:23.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c63d511d-6455-495c-ab3f-b3dd3e4ad491 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3722025-01-22T05:15:24.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f94a20ce-12b3-4b47-9e36-f9ca91d3b790 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3732025-01-22T05:15:24.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f94a20ce-12b3-4b47-9e36-f9ca91d3b790 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3742025-01-22T05:15:24.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f94a20ce-12b3-4b47-9e36-f9ca91d3b790 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3752025-01-22T05:15:25.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bd1830d4-21b2-496f-b3a9-7c9ee721a5fd roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3762025-01-22T05:15:25.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bd1830d4-21b2-496f-b3a9-7c9ee721a5fd resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3772025-01-22T05:15:25.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bd1830d4-21b2-496f-b3a9-7c9ee721a5fd response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3782025-01-22T05:15:25.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 820 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = c0d6a2b0-1112-4e23-a6e4-737756052e4a response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
3792025-01-22T05:15:26.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ee9925a2-06c8-4a9b-bdf5-1bb3609c4d0f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3802025-01-22T05:15:26.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ee9925a2-06c8-4a9b-bdf5-1bb3609c4d0f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3812025-01-22T05:15:26.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ee9925a2-06c8-4a9b-bdf5-1bb3609c4d0f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3822025-01-22T05:15:27.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0c8845fb-8d8f-4d1e-81fa-9cde521da802 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3832025-01-22T05:15:27.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0c8845fb-8d8f-4d1e-81fa-9cde521da802 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3842025-01-22T05:15:27.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0c8845fb-8d8f-4d1e-81fa-9cde521da802 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3852025-01-22T05:15:28.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 308623aa-9486-441c-9692-0356aeb5a92a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3862025-01-22T05:15:28.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 308623aa-9486-441c-9692-0356aeb5a92a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3872025-01-22T05:15:28.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 308623aa-9486-441c-9692-0356aeb5a92a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3882025-01-22T05:15:29.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aa109c63-0cca-4609-aa5f-10235d0c70e2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3892025-01-22T05:15:29.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aa109c63-0cca-4609-aa5f-10235d0c70e2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3902025-01-22T05:15:29.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aa109c63-0cca-4609-aa5f-10235d0c70e2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3912025-01-22T05:15:30.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a88b8177-7a10-45cc-91ae-e6733a099639 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3922025-01-22T05:15:30.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a88b8177-7a10-45cc-91ae-e6733a099639 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3932025-01-22T05:15:30.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a88b8177-7a10-45cc-91ae-e6733a099639 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
3942025-01-22T05:15:30.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = ced90e6e-ed1e-4ccb-bbe3-86d9363d9b51 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
3952025-01-22T05:15:30.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = ced90e6e-ed1e-4ccb-bbe3-86d9363d9b51 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
3962025-01-22T05:15:30.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = ced90e6e-ed1e-4ccb-bbe3-86d9363d9b51 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
3972025-01-22T05:15:30.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 75c7b302-b612-470d-92ae-32a929496e61 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
3982025-01-22T05:15:30.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 75c7b302-b612-470d-92ae-32a929496e61 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
3992025-01-22T05:15:30.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 75c7b302-b612-470d-92ae-32a929496e61 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
4002025-01-22T05:15:31.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f2686f3c-bdaa-47ba-8602-85021b194b9c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
4012025-01-22T05:15:31.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f2686f3c-bdaa-47ba-8602-85021b194b9c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
4022025-01-22T05:15:31.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f2686f3c-bdaa-47ba-8602-85021b194b9c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
4032025-01-22T05:15:32.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1b312f57-f062-4bea-972a-f194ff80595e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
4042025-01-22T05:15:32.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1b312f57-f062-4bea-972a-f194ff80595e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
4052025-01-22T05:15:32.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1b312f57-f062-4bea-972a-f194ff80595e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
4062025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
4072025-01-22T05:15:32.821ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4082025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
4092025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4102025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
4112025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4122025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
4132025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
4142025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
4152025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4162025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4172025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
4182025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4192025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
4202025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
4212025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4222025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
4232025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
4242025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4252025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4262025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
4272025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
4282025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
4292025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4302025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
4312025-01-22T05:15:32.821ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:05:32.821433816 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4322025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4332025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
4342025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4352025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
4362025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
4372025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4382025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4392025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4402025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
4412025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
4422025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4432025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
4442025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
4452025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4462025-01-22T05:15:32.821ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
4472025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.8\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
4482025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4492025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4502025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4512025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4522025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4532025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4542025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4552025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
4562025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
4572025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4582025-01-22T05:15:32.821ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4592025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4602025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
4612025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4622025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
4632025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4642025-01-22T05:15:32.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4652025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
4662025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
4672025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4682025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4692025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
4702025-01-22T05:15:32.822ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4712025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4722025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
4732025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4742025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4752025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4762025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4772025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4782025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
4792025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4802025-01-22T05:15:32.822ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11115, tv_nsec: 171675902 } })
4812025-01-22T05:15:32.822ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11115, tv_nsec: 171679512 } })
4822025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4832025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4842025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4852025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4862025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4872025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4882025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4892025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
4902025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.324837ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4912025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
4922025-01-22T05:15:32.822ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.299277ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4932025-01-22T05:15:32.824ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4942025-01-22T05:15:32.824ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11115, tv_nsec: 174205044 } })
4952025-01-22T05:15:32.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
4962025-01-22T05:15:32.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4972025-01-22T05:15:32.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982025-01-22T05:15:32.825ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.509842ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4992025-01-22T05:15:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5002025-01-22T05:15:32.825ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5012025-01-22T05:15:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5022025-01-22T05:15:32.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5032025-01-22T05:15:32.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5042025-01-22T05:15:32.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5052025-01-22T05:15:32.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5062025-01-22T05:15:32.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5072025-01-22T05:15:32.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082025-01-22T05:15:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5092025-01-22T05:15:32.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5102025-01-22T05:15:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5112025-01-22T05:15:32.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11115, tv_nsec: 179449820 } })
5122025-01-22T05:15:32.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
5132025-01-22T05:15:32.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5142025-01-22T05:15:32.830ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:05:32.821433816 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5152025-01-22T05:15:32.830ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.113656ms iteration = 6 status = {"expiration":"2025-01-22T05:05:32.821433816Z","pruned":[]}
5162025-01-22T05:15:32.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5172025-01-22T05:15:32.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5182025-01-22T05:15:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5192025-01-22T05:15:32.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5202025-01-22T05:15:32.832ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212025-01-22T05:15:32.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5222025-01-22T05:15:32.833ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5232025-01-22T05:15:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
5242025-01-22T05:15:32.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
5252025-01-22T05:15:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
5262025-01-22T05:15:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
5272025-01-22T05:15:32.835ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5282025-01-22T05:15:32.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5292025-01-22T05:15:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5302025-01-22T05:15:32.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5312025-01-22T05:15:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5322025-01-22T05:15:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5332025-01-22T05:15:32.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5342025-01-22T05:15:32.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5352025-01-22T05:15:32.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5362025-01-22T05:15:32.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5372025-01-22T05:15:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5382025-01-22T05:15:32.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5392025-01-22T05:15:32.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5402025-01-22T05:15:32.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5412025-01-22T05:15:32.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5422025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
5432025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5442025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
5452025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
5462025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5472025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5482025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
5492025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5502025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
5512025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5522025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5532025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5542025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5552025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5562025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5572025-01-22T05:15:32.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5582025-01-22T05:15:32.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5592025-01-22T05:15:32.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602025-01-22T05:15:32.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5612025-01-22T05:15:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5622025-01-22T05:15:32.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5632025-01-22T05:15:32.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5642025-01-22T05:15:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5652025-01-22T05:15:32.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
5662025-01-22T05:15:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
5672025-01-22T05:15:32.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5682025-01-22T05:15:32.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5692025-01-22T05:15:32.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.594547ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
5702025-01-22T05:15:32.859ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.318382ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
5712025-01-22T05:15:32.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5722025-01-22T05:15:32.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5732025-01-22T05:15:32.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11115, tv_nsec: 210105415 } })
5742025-01-22T05:15:32.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
5752025-01-22T05:15:32.878ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5762025-01-22T05:15:32.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5772025-01-22T05:15:32.880ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5782025-01-22T05:15:32.880ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5792025-01-22T05:15:32.880ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.358309ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5802025-01-22T05:15:32.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5812025-01-22T05:15:32.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5822025-01-22T05:15:32.886ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5832025-01-22T05:15:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5842025-01-22T05:15:32.888ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5852025-01-22T05:15:32.888ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5862025-01-22T05:15:32.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5872025-01-22T05:15:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5882025-01-22T05:15:32.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5892025-01-22T05:15:32.890ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5902025-01-22T05:15:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5912025-01-22T05:15:32.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5922025-01-22T05:15:32.891ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5932025-01-22T05:15:32.891ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5942025-01-22T05:15:32.891ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.575458ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5952025-01-22T05:15:32.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5962025-01-22T05:15:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
5972025-01-22T05:15:32.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5982025-01-22T05:15:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5992025-01-22T05:15:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6002025-01-22T05:15:32.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6012025-01-22T05:15:32.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6022025-01-22T05:15:32.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6032025-01-22T05:15:32.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6042025-01-22T05:15:32.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6052025-01-22T05:15:32.899ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6062025-01-22T05:15:32.899ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6072025-01-22T05:15:32.899ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6082025-01-22T05:15:32.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6092025-01-22T05:15:32.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6102025-01-22T05:15:32.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6112025-01-22T05:15:32.902ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6122025-01-22T05:15:32.902ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6132025-01-22T05:15:32.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6142025-01-22T05:15:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6152025-01-22T05:15:32.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6162025-01-22T05:15:32.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6172025-01-22T05:15:32.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6182025-01-22T05:15:32.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6192025-01-22T05:15:32.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6202025-01-22T05:15:32.907ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6212025-01-22T05:15:32.907ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6222025-01-22T05:15:32.907ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6232025-01-22T05:15:32.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6242025-01-22T05:15:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6252025-01-22T05:15:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6262025-01-22T05:15:32.907ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6272025-01-22T05:15:32.907ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.757707ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6282025-01-22T05:15:32.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6292025-01-22T05:15:32.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6302025-01-22T05:15:32.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6312025-01-22T05:15:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6322025-01-22T05:15:32.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6332025-01-22T05:15:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6342025-01-22T05:15:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6352025-01-22T05:15:32.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6362025-01-22T05:15:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6372025-01-22T05:15:32.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6382025-01-22T05:15:32.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6392025-01-22T05:15:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6402025-01-22T05:15:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6412025-01-22T05:15:32.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6422025-01-22T05:15:32.915ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6432025-01-22T05:15:32.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6442025-01-22T05:15:32.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6452025-01-22T05:15:32.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462025-01-22T05:15:32.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.922136ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
6472025-01-22T05:15:32.916ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6482025-01-22T05:15:32.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6492025-01-22T05:15:32.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
6502025-01-22T05:15:32.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.083437ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
6512025-01-22T05:15:32.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6522025-01-22T05:15:32.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6532025-01-22T05:15:32.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6542025-01-22T05:15:32.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6552025-01-22T05:15:32.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6562025-01-22T05:15:32.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6572025-01-22T05:15:32.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6582025-01-22T05:15:32.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6592025-01-22T05:15:32.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6602025-01-22T05:15:32.922ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6612025-01-22T05:15:32.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6622025-01-22T05:15:32.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
6632025-01-22T05:15:32.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
6642025-01-22T05:15:32.933ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6652025-01-22T05:15:32.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.93532ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6662025-01-22T05:15:32.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6672025-01-22T05:15:32.936ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6682025-01-22T05:15:32.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6692025-01-22T05:15:32.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6702025-01-22T05:15:32.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6712025-01-22T05:15:32.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.13954ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6722025-01-22T05:15:32.956ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
6732025-01-22T05:15:32.956ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 135.035911ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
6742025-01-22T05:15:32.958ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6752025-01-22T05:15:32.958ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6762025-01-22T05:15:32.958ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.426168ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6772025-01-22T05:15:32.958ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6782025-01-22T05:15:32.958ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
6792025-01-22T05:15:32.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6802025-01-22T05:15:32.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6812025-01-22T05:15:32.961ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6822025-01-22T05:15:32.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
6832025-01-22T05:15:32.978ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6842025-01-22T05:15:32.978ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c284f04-ad04-4033-9f78-7db5ff0d787a", "content-length": "26", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
6852025-01-22T05:15:32.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6862025-01-22T05:15:32.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6872025-01-22T05:15:32.982ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
6882025-01-22T05:15:32.982ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6892025-01-22T05:15:32.983ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70c5d251-2a96-4e0d-932a-8bbb418f1354", "content-length": "26", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
6902025-01-22T05:15:32.983ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6912025-01-22T05:15:32.984ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6922025-01-22T05:15:33.069ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6932025-01-22T05:15:33.147ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6942025-01-22T05:15:33.148ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "70196bed-af56-47e2-8a0e-e2ededc3c40c", "content-length": "1", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
6952025-01-22T05:15:33.149ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6962025-01-22T05:15:33.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6972025-01-22T05:15:33.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
6982025-01-22T05:15:33.215ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6992025-01-22T05:15:33.215ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "864c600b-3b7d-4a2f-a6f6-47ad7b5cba1c", "content-length": "26", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
7002025-01-22T05:15:33.215ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7012025-01-22T05:15:33.217ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
7022025-01-22T05:15:33.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bbfd2f66-c412-4807-b3dc-0f9bc32a64e9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
7032025-01-22T05:15:33.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bbfd2f66-c412-4807-b3dc-0f9bc32a64e9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
7042025-01-22T05:15:33.236ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7052025-01-22T05:15:33.236ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7062025-01-22T05:15:33.236ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "df8f32fd-44a1-4505-b81c-22b63bef7715", "content-length": "372", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
7072025-01-22T05:15:33.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7082025-01-22T05:15:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7092025-01-22T05:15:33.238ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7102025-01-22T05:15:33.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7112025-01-22T05:15:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7122025-01-22T05:15:33.238ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "00ee43fc-03be-4e61-ab43-95abb86d50f8", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7132025-01-22T05:15:33.238ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7142025-01-22T05:15:33.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152025-01-22T05:15:33.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7162025-01-22T05:15:33.240ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a7999be0-cd4c-43fd-a1f2-efb40177fd03", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7172025-01-22T05:15:33.240ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7182025-01-22T05:15:33.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7192025-01-22T05:15:33.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7202025-01-22T05:15:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7212025-01-22T05:15:33.242ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7222025-01-22T05:15:33.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 421.16774ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7232025-01-22T05:15:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7242025-01-22T05:15:33.243ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7252025-01-22T05:15:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7262025-01-22T05:15:33.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7272025-01-22T05:15:33.247ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 425.988347ms iteration = 11 status = null
7282025-01-22T05:15:33.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
7292025-01-22T05:15:33.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
7302025-01-22T05:15:33.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
7312025-01-22T05:15:33.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 24784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bbfd2f66-c412-4807-b3dc-0f9bc32a64e9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
7322025-01-22T05:15:33.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7332025-01-22T05:15:33.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
7342025-01-22T05:15:33.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7352025-01-22T05:15:33.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7362025-01-22T05:15:33.254ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 432.672894ms iteration = 11 status = {}
7372025-01-22T05:15:33.256ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 434.734346ms iteration = 11 status = 0
7382025-01-22T05:15:33.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 427.519499ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7392025-01-22T05:15:33.271ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7402025-01-22T05:15:33.271ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7412025-01-22T05:15:33.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7422025-01-22T05:15:33.272ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7432025-01-22T05:15:33.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7442025-01-22T05:15:33.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7452025-01-22T05:15:33.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7462025-01-22T05:15:33.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 434.163494ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7472025-01-22T05:15:33.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482025-01-22T05:15:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7492025-01-22T05:15:33.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7502025-01-22T05:15:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7512025-01-22T05:15:33.285ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
7522025-01-22T05:15:33.285ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7532025-01-22T05:15:33.285ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
7542025-01-22T05:15:33.285ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 464.326149ms iteration = 6 status = {"generation":2}
7552025-01-22T05:15:33.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7562025-01-22T05:15:33.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7572025-01-22T05:15:33.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7582025-01-22T05:15:33.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
7592025-01-22T05:15:33.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
7602025-01-22T05:15:33.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
7612025-01-22T05:15:33.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7622025-01-22T05:15:33.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7632025-01-22T05:15:33.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7642025-01-22T05:15:33.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7652025-01-22T05:15:33.321ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7662025-01-22T05:15:33.321ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7672025-01-22T05:15:33.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7682025-01-22T05:15:33.321ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "da07b459-fbcd-4265-b5e3-e04007df6c8b", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
7692025-01-22T05:15:33.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7702025-01-22T05:15:33.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7712025-01-22T05:15:33.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7722025-01-22T05:15:33.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7732025-01-22T05:15:33.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7742025-01-22T05:15:33.324ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7752025-01-22T05:15:33.324ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3da7ce0d-ed65-4847-b214-7e12e845ebec", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7762025-01-22T05:15:33.324ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7772025-01-22T05:15:33.326ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7c136331-f409-4181-a48c-a26987b47a22", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7782025-01-22T05:15:33.326ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7792025-01-22T05:15:33.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7802025-01-22T05:15:33.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7812025-01-22T05:15:33.328ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "99e87028-d9d8-4e84-b01c-04295d1f68b6", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7822025-01-22T05:15:33.328ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7832025-01-22T05:15:33.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7842025-01-22T05:15:33.330ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7852025-01-22T05:15:33.330ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 509.002909ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7862025-01-22T05:15:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7872025-01-22T05:15:33.330ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7882025-01-22T05:15:33.330ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7892025-01-22T05:15:33.330ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
7902025-01-22T05:15:33.330ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 509.231403ms iteration = 6 status = {"generation":1}
7912025-01-22T05:15:33.333ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7922025-01-22T05:15:33.333ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7932025-01-22T05:15:33.333ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "db5ed3bc-c6e6-479a-8a90-b6354eaec387", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
7942025-01-22T05:15:33.335ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 513.612532ms iteration = 11 status = {}
7952025-01-22T05:15:33.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7962025-01-22T05:15:33.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7972025-01-22T05:15:33.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7982025-01-22T05:15:33.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7992025-01-22T05:15:33.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8002025-01-22T05:15:33.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8012025-01-22T05:15:33.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8022025-01-22T05:15:33.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8032025-01-22T05:15:33.350ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 529.254881ms iteration = 13 status = {"physical_disks_added":0}
8042025-01-22T05:15:33.355ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
8052025-01-22T05:15:33.355ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 534.467167ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
8062025-01-22T05:15:33.356ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 534.61891ms iteration = 4 status = {}
8072025-01-22T05:15:33.359ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
8082025-01-22T05:15:33.359ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 537.858267ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
8092025-01-22T05:15:33.367ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8102025-01-22T05:15:33.368ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "80dd1d4d-4bf3-4cba-96c9-25cacd9c4405", "content-length": "691", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
8112025-01-22T05:15:33.368ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8122025-01-22T05:15:33.368ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8132025-01-22T05:15:33.368ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8142025-01-22T05:15:33.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8152025-01-22T05:15:33.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8162025-01-22T05:15:33.370ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 548.980503ms iteration = 11 status = {}
8172025-01-22T05:15:33.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8182025-01-22T05:15:33.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8192025-01-22T05:15:33.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8202025-01-22T05:15:33.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8212025-01-22T05:15:33.375ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8222025-01-22T05:15:33.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8232025-01-22T05:15:33.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8242025-01-22T05:15:33.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8252025-01-22T05:15:33.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8262025-01-22T05:15:33.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
8272025-01-22T05:15:33.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8282025-01-22T05:15:33.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8292025-01-22T05:15:33.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8302025-01-22T05:15:33.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8312025-01-22T05:15:33.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8322025-01-22T05:15:33.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8332025-01-22T05:15:33.384ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
8342025-01-22T05:15:33.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8352025-01-22T05:15:33.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8362025-01-22T05:15:33.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8372025-01-22T05:15:33.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8382025-01-22T05:15:33.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8392025-01-22T05:15:33.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8402025-01-22T05:15:33.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8412025-01-22T05:15:33.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8422025-01-22T05:15:33.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8432025-01-22T05:15:33.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8442025-01-22T05:15:33.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8452025-01-22T05:15:33.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8462025-01-22T05:15:33.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8472025-01-22T05:15:33.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8482025-01-22T05:15:33.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8492025-01-22T05:15:33.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8502025-01-22T05:15:33.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8512025-01-22T05:15:33.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8522025-01-22T05:15:33.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8532025-01-22T05:15:33.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8542025-01-22T05:15:33.400ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8552025-01-22T05:15:33.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8562025-01-22T05:15:33.404ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8572025-01-22T05:15:33.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8582025-01-22T05:15:33.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8592025-01-22T05:15:33.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8602025-01-22T05:15:33.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8612025-01-22T05:15:33.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8622025-01-22T05:15:33.411ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8632025-01-22T05:15:33.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8642025-01-22T05:15:33.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8652025-01-22T05:15:33.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8662025-01-22T05:15:33.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8672025-01-22T05:15:33.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8682025-01-22T05:15:33.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8692025-01-22T05:15:33.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8702025-01-22T05:15:33.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8712025-01-22T05:15:33.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8722025-01-22T05:15:33.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8732025-01-22T05:15:33.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8742025-01-22T05:15:33.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8752025-01-22T05:15:33.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8762025-01-22T05:15:33.422ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8772025-01-22T05:15:33.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8782025-01-22T05:15:33.423ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8792025-01-22T05:15:33.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8802025-01-22T05:15:33.425ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8812025-01-22T05:15:33.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8822025-01-22T05:15:33.428ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8832025-01-22T05:15:33.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8842025-01-22T05:15:33.435ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 9396e9bd-ba9d-48e4-a278-7b7b84c18361, kind: Service { id: 1921c966-20bc-43ec-90bc-8bb3cb3c388f }, name: Name("nexus-1921c966-20bc-43ec-90bc-8bb3cb3c388f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6d43724-d167-4d59-9642-c64ff9718927, kind: Service { id: 3fbe3917-aca1-4b36-8119-948b03a24746 }, name: Name("nexus-3fbe3917-aca1-4b36-8119-948b03a24746"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dfba0bbc-9240-4b6a-84cb-7ae51a2f8f8a, kind: Service { id: 5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a }, name: Name("nexus-5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 603573fe-43d9-432a-ad48-f1cdca1d4167, kind: Service { id: c7d22dc6-a1ac-4ae2-9658-16be14c1294a }, name: Name("external-dns-c7d22dc6-a1ac-4ae2-9658-16be14c1294a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 165])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9917397f-ffee-49ec-b869-d35b0b743c02, kind: Service { id: 358028b5-56dd-4575-bbf5-bf3b9b03d80f }, name: Name("external-dns-358028b5-56dd-4575-bbf5-bf3b9b03d80f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 38])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
8852025-01-22T05:15:33.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8862025-01-22T05:15:33.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8872025-01-22T05:15:33.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8882025-01-22T05:15:33.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8892025-01-22T05:15:33.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8902025-01-22T05:15:33.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8912025-01-22T05:15:33.439ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8922025-01-22T05:15:33.441ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 603573fe-43d9-432a-ad48-f1cdca1d4167, kind: Service { id: c7d22dc6-a1ac-4ae2-9658-16be14c1294a }, name: Name("external-dns-c7d22dc6-a1ac-4ae2-9658-16be14c1294a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 165])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9917397f-ffee-49ec-b869-d35b0b743c02, kind: Service { id: 358028b5-56dd-4575-bbf5-bf3b9b03d80f }, name: Name("external-dns-358028b5-56dd-4575-bbf5-bf3b9b03d80f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 38])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 9396e9bd-ba9d-48e4-a278-7b7b84c18361, kind: Service { id: 1921c966-20bc-43ec-90bc-8bb3cb3c388f }, name: Name("nexus-1921c966-20bc-43ec-90bc-8bb3cb3c388f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6d43724-d167-4d59-9642-c64ff9718927, kind: Service { id: 3fbe3917-aca1-4b36-8119-948b03a24746 }, name: Name("nexus-3fbe3917-aca1-4b36-8119-948b03a24746"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dfba0bbc-9240-4b6a-84cb-7ae51a2f8f8a, kind: Service { id: 5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a }, name: Name("nexus-5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
8932025-01-22T05:15:33.441ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
8942025-01-22T05:15:33.492ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8952025-01-22T05:15:33.492ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebb92533-36f8-4474-aa65-db555413ac1a", "content-length": "134", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
8962025-01-22T05:15:33.492ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8972025-01-22T05:15:33.492ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
8982025-01-22T05:15:33.492ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8992025-01-22T05:15:33.492ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9002025-01-22T05:15:33.492ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9012025-01-22T05:15:33.492ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9022025-01-22T05:15:33.492ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9032025-01-22T05:15:33.492ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9042025-01-22T05:15:33.493ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9052025-01-22T05:15:33.493ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9062025-01-22T05:15:33.493ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
9072025-01-22T05:15:33.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9082025-01-22T05:15:33.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9092025-01-22T05:15:33.495ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9102025-01-22T05:15:33.495ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "55f65702-aa5a-4369-94d9-a2d57b330fe3", "content-length": "2", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
9112025-01-22T05:15:33.495ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9122025-01-22T05:15:33.495ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "19c6f002-3afd-4002-b65c-f52abbebaa0b", "content-length": "51", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
9132025-01-22T05:15:33.495ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
9142025-01-22T05:15:33.495ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9152025-01-22T05:15:33.550ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: af8308ab-46c4-4104-b864-f43b03f195e3, time_created: 2025-01-22T05:11:20.582572Z, time_modified: 2025-01-22T05:11:20.582572Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
9162025-01-22T05:15:33.550ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
9172025-01-22T05:15:33.550ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9182025-01-22T05:15:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9192025-01-22T05:15:33.553ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9202025-01-22T05:15:33.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9212025-01-22T05:15:33.555ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9222025-01-22T05:15:33.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
9232025-01-22T05:15:33.588ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
9242025-01-22T05:15:33.592ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "70addbbb-94d2-4bda-952a-3f74fbfa06c3", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
9252025-01-22T05:15:33.592ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
9262025-01-22T05:15:33.592ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9272025-01-22T05:15:33.593ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "328c2c40-5212-46cf-961a-155f266f52a6", "content-length": "682", "date": "Wed, 22 Jan 2025 05:15:32 GMT"} })
9282025-01-22T05:15:33.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9292025-01-22T05:15:33.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9302025-01-22T05:15:33.593ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "fe1f1a12-fc3b-42bc-804a-9f8e47be5a4b", "date": "Wed, 22 Jan 2025 05:15:33 GMT"} })
9312025-01-22T05:15:33.595ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
9322025-01-22T05:15:33.595ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 773.623719ms
9332025-01-22T05:15:33.595ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 773.633409ms iteration = 2 status = {}
9342025-01-22T05:15:33.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9352025-01-22T05:15:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9362025-01-22T05:15:33.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9372025-01-22T05:15:33.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9382025-01-22T05:15:33.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9392025-01-22T05:15:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9402025-01-22T05:15:33.610ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 788.90504ms iteration = 11 status = {}
9412025-01-22T05:15:34.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d92b32ab-c380-4e3e-852c-9b7b5886592b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9422025-01-22T05:15:34.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d92b32ab-c380-4e3e-852c-9b7b5886592b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9432025-01-22T05:15:34.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d92b32ab-c380-4e3e-852c-9b7b5886592b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9442025-01-22T05:15:34.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 46162fec-6c8d-48ad-a387-00ba6b2ee31a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
9452025-01-22T05:15:34.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 46162fec-6c8d-48ad-a387-00ba6b2ee31a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
9462025-01-22T05:15:34.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 46162fec-6c8d-48ad-a387-00ba6b2ee31a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
9472025-01-22T05:15:35.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f8e0755e-2553-411b-b10e-819ae156419d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9482025-01-22T05:15:35.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f8e0755e-2553-411b-b10e-819ae156419d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9492025-01-22T05:15:35.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f8e0755e-2553-411b-b10e-819ae156419d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9502025-01-22T05:15:35.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 626 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 0b0823f9-720e-48a0-8735-7cac52947cd3 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
9512025-01-22T05:15:36.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 683ef8c7-e48b-4a7f-992f-c651164a75b6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9522025-01-22T05:15:36.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 683ef8c7-e48b-4a7f-992f-c651164a75b6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9532025-01-22T05:15:36.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 683ef8c7-e48b-4a7f-992f-c651164a75b6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9542025-01-22T05:15:37.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8fb37490-67ae-4d69-8980-c93dedad065d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9552025-01-22T05:15:37.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8fb37490-67ae-4d69-8980-c93dedad065d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9562025-01-22T05:15:37.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8fb37490-67ae-4d69-8980-c93dedad065d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9572025-01-22T05:15:38.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f47047a6-a2d6-43bf-aacb-0db36498bc2b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9582025-01-22T05:15:38.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f47047a6-a2d6-43bf-aacb-0db36498bc2b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9592025-01-22T05:15:38.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f47047a6-a2d6-43bf-aacb-0db36498bc2b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9602025-01-22T05:15:39.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 25ed65fc-a545-4345-85c1-a3138230aa03 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9612025-01-22T05:15:39.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 25ed65fc-a545-4345-85c1-a3138230aa03 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9622025-01-22T05:15:39.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 25ed65fc-a545-4345-85c1-a3138230aa03 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9632025-01-22T05:15:40.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0513cfcb-891d-4737-8749-0130637433f3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9642025-01-22T05:15:40.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0513cfcb-891d-4737-8749-0130637433f3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9652025-01-22T05:15:40.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0513cfcb-891d-4737-8749-0130637433f3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9662025-01-22T05:15:41.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fec16aad-a7a0-4e94-bab7-cc3c427a739b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9672025-01-22T05:15:41.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fec16aad-a7a0-4e94-bab7-cc3c427a739b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9682025-01-22T05:15:41.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fec16aad-a7a0-4e94-bab7-cc3c427a739b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9692025-01-22T05:15:42.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 354739be-8056-4c3f-a6f6-8b8d77a80d38 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9702025-01-22T05:15:42.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 354739be-8056-4c3f-a6f6-8b8d77a80d38 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9712025-01-22T05:15:42.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 354739be-8056-4c3f-a6f6-8b8d77a80d38 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9722025-01-22T05:15:42.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
9732025-01-22T05:15:42.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9742025-01-22T05:15:42.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9752025-01-22T05:15:42.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
9762025-01-22T05:15:42.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9772025-01-22T05:15:42.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9782025-01-22T05:15:42.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9792025-01-22T05:15:42.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9802025-01-22T05:15:42.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9812025-01-22T05:15:42.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9822025-01-22T05:15:42.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9832025-01-22T05:15:42.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9842025-01-22T05:15:42.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9852025-01-22T05:15:42.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9862025-01-22T05:15:42.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9872025-01-22T05:15:42.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
9882025-01-22T05:15:42.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9892025-01-22T05:15:42.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9902025-01-22T05:15:42.846ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
9912025-01-22T05:15:42.846ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.398568ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
9922025-01-22T05:15:42.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.206587ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9932025-01-22T05:15:43.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e6b49ec9-c2a4-4061-8e32-a43e7d558b79 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9942025-01-22T05:15:43.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e6b49ec9-c2a4-4061-8e32-a43e7d558b79 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9952025-01-22T05:15:43.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e6b49ec9-c2a4-4061-8e32-a43e7d558b79 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9962025-01-22T05:15:44.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = db8815b3-449d-4037-b1d6-1ee7f54ac293 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9972025-01-22T05:15:44.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = db8815b3-449d-4037-b1d6-1ee7f54ac293 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9982025-01-22T05:15:44.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = db8815b3-449d-4037-b1d6-1ee7f54ac293 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
9992025-01-22T05:15:45.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9cd32852-f921-4211-a6fe-bec3fe24ce36 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10002025-01-22T05:15:45.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9cd32852-f921-4211-a6fe-bec3fe24ce36 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10012025-01-22T05:15:45.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9cd32852-f921-4211-a6fe-bec3fe24ce36 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10022025-01-22T05:15:45.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 555 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 2ae77577-0a41-4e5a-9850-30fbb860fc88 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
10032025-01-22T05:15:46.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e8a18619-6fb0-4219-a202-fba87f6f68ff roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10042025-01-22T05:15:46.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e8a18619-6fb0-4219-a202-fba87f6f68ff resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10052025-01-22T05:15:46.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e8a18619-6fb0-4219-a202-fba87f6f68ff response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10062025-01-22T05:15:47.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 605eb737-79b4-4112-a6e3-2dcb91fb0aad roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10072025-01-22T05:15:47.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 605eb737-79b4-4112-a6e3-2dcb91fb0aad resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10082025-01-22T05:15:47.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 605eb737-79b4-4112-a6e3-2dcb91fb0aad response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10092025-01-22T05:15:48.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e6bd0b10-c191-4be9-acac-95c5379c0f7c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10102025-01-22T05:15:48.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e6bd0b10-c191-4be9-acac-95c5379c0f7c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10112025-01-22T05:15:48.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e6bd0b10-c191-4be9-acac-95c5379c0f7c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10122025-01-22T05:15:49.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5128d1cd-e4cb-4dcc-8beb-b0384d0c7a9e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10132025-01-22T05:15:49.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5128d1cd-e4cb-4dcc-8beb-b0384d0c7a9e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10142025-01-22T05:15:49.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5128d1cd-e4cb-4dcc-8beb-b0384d0c7a9e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10152025-01-22T05:15:50.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d91ccfce-4585-4cf0-a31c-ced8124f4074 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10162025-01-22T05:15:50.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d91ccfce-4585-4cf0-a31c-ced8124f4074 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10172025-01-22T05:15:50.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d91ccfce-4585-4cf0-a31c-ced8124f4074 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10182025-01-22T05:15:51.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f124c0e2-cf34-4b92-ab3b-fb7ca83cf3e9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10192025-01-22T05:15:51.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f124c0e2-cf34-4b92-ab3b-fb7ca83cf3e9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10202025-01-22T05:15:51.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f124c0e2-cf34-4b92-ab3b-fb7ca83cf3e9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10212025-01-22T05:15:52.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 38ac72e7-f8c0-445d-a69a-6cb3fd6e8e41 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10222025-01-22T05:15:52.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 38ac72e7-f8c0-445d-a69a-6cb3fd6e8e41 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10232025-01-22T05:15:52.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 38ac72e7-f8c0-445d-a69a-6cb3fd6e8e41 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10242025-01-22T05:15:52.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
10252025-01-22T05:15:52.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10262025-01-22T05:15:52.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10272025-01-22T05:15:52.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
10282025-01-22T05:15:52.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10292025-01-22T05:15:52.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10302025-01-22T05:15:52.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10312025-01-22T05:15:52.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10322025-01-22T05:15:52.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10332025-01-22T05:15:52.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10342025-01-22T05:15:52.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10352025-01-22T05:15:52.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10362025-01-22T05:15:52.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10372025-01-22T05:15:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10382025-01-22T05:15:52.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10392025-01-22T05:15:52.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
10402025-01-22T05:15:52.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10412025-01-22T05:15:52.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10422025-01-22T05:15:52.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
10432025-01-22T05:15:52.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.729633ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
10442025-01-22T05:15:52.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.160725ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10452025-01-22T05:15:53.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 90210fde-3715-48d2-9916-e46eb8caa640 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10462025-01-22T05:15:53.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 90210fde-3715-48d2-9916-e46eb8caa640 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10472025-01-22T05:15:53.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 90210fde-3715-48d2-9916-e46eb8caa640 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10482025-01-22T05:15:54.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 02cf9bf8-9e1b-4617-b602-e87cc28d0624 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10492025-01-22T05:15:54.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 02cf9bf8-9e1b-4617-b602-e87cc28d0624 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10502025-01-22T05:15:54.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 02cf9bf8-9e1b-4617-b602-e87cc28d0624 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10512025-01-22T05:15:55.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a3a7e64e-592e-44e9-90c4-282c1c96a9e2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10522025-01-22T05:15:55.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a3a7e64e-592e-44e9-90c4-282c1c96a9e2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10532025-01-22T05:15:55.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a3a7e64e-592e-44e9-90c4-282c1c96a9e2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10542025-01-22T05:15:55.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 811 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = c1234da1-a21b-4edc-9a8d-8640ba670c44 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
10552025-01-22T05:15:56.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a090d463-3b5f-4a75-b641-84c570ac5210 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10562025-01-22T05:15:56.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a090d463-3b5f-4a75-b641-84c570ac5210 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10572025-01-22T05:15:56.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a090d463-3b5f-4a75-b641-84c570ac5210 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10582025-01-22T05:15:57.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 08de22fa-41e6-4dbb-93c0-c6aff5ca357a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10592025-01-22T05:15:57.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 08de22fa-41e6-4dbb-93c0-c6aff5ca357a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10602025-01-22T05:15:57.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 08de22fa-41e6-4dbb-93c0-c6aff5ca357a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10612025-01-22T05:15:58.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e02f71bf-4dda-445c-a9e9-00bf109428cb roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10622025-01-22T05:15:58.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e02f71bf-4dda-445c-a9e9-00bf109428cb resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10632025-01-22T05:15:58.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e02f71bf-4dda-445c-a9e9-00bf109428cb response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10642025-01-22T05:15:59.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f6d66921-0632-4d21-814d-8b35f4583600 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10652025-01-22T05:15:59.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f6d66921-0632-4d21-814d-8b35f4583600 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10662025-01-22T05:15:59.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f6d66921-0632-4d21-814d-8b35f4583600 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10672025-01-22T05:16:00.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0914e670-9f2c-4935-b0c8-0d4c8f0354ba roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10682025-01-22T05:16:00.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0914e670-9f2c-4935-b0c8-0d4c8f0354ba resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10692025-01-22T05:16:00.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0914e670-9f2c-4935-b0c8-0d4c8f0354ba response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10702025-01-22T05:16:00.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = dbb9677b-e698-4553-8c08-2ea05e74c29f roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
10712025-01-22T05:16:00.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = dbb9677b-e698-4553-8c08-2ea05e74c29f resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
10722025-01-22T05:16:00.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = dbb9677b-e698-4553-8c08-2ea05e74c29f response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
10732025-01-22T05:16:00.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 806216a5-b1d7-4d2e-9edc-4d7c40ee9ff8 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
10742025-01-22T05:16:00.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 806216a5-b1d7-4d2e-9edc-4d7c40ee9ff8 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
10752025-01-22T05:16:00.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 806216a5-b1d7-4d2e-9edc-4d7c40ee9ff8 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
10762025-01-22T05:16:01.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3a938045-258b-4add-9fdc-f6c8eaf50ded roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10772025-01-22T05:16:01.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3a938045-258b-4add-9fdc-f6c8eaf50ded resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10782025-01-22T05:16:01.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3a938045-258b-4add-9fdc-f6c8eaf50ded response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
10792025-01-22T05:16:02.821ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
10802025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10812025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
10822025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
10832025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10842025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10852025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
10862025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
10872025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10882025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
10892025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
10902025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10912025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
10922025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10932025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
10942025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10952025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10962025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
10972025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10982025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
10992025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11002025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
11012025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11022025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11032025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
11042025-01-22T05:16:02.822ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11052025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
11062025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11072025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11082025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11092025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11102025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11112025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11122025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11132025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11142025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11152025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11162025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11172025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11182025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11192025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11202025-01-22T05:16:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11212025-01-22T05:16:02.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11222025-01-22T05:16:02.825ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.004582ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11232025-01-22T05:16:02.825ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242025-01-22T05:16:02.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11252025-01-22T05:16:02.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11145, tv_nsec: 175535751 } })
11262025-01-22T05:16:02.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
11272025-01-22T05:16:02.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11282025-01-22T05:16:02.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11292025-01-22T05:16:02.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11302025-01-22T05:16:02.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11312025-01-22T05:16:02.827ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11322025-01-22T05:16:02.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11332025-01-22T05:16:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11342025-01-22T05:16:02.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11352025-01-22T05:16:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11362025-01-22T05:16:02.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11145, tv_nsec: 179668425 } })
11372025-01-22T05:16:02.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
11382025-01-22T05:16:02.831ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11392025-01-22T05:16:02.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11402025-01-22T05:16:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11412025-01-22T05:16:02.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11422025-01-22T05:16:02.833ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11145, tv_nsec: 182927711 } })
11432025-01-22T05:16:02.833ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
11442025-01-22T05:16:02.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11452025-01-22T05:16:02.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11462025-01-22T05:16:02.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11472025-01-22T05:16:02.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11482025-01-22T05:16:02.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11492025-01-22T05:16:02.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11502025-01-22T05:16:02.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11512025-01-22T05:16:02.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11522025-01-22T05:16:02.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11532025-01-22T05:16:02.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11542025-01-22T05:16:02.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11552025-01-22T05:16:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11562025-01-22T05:16:02.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11572025-01-22T05:16:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11582025-01-22T05:16:02.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11592025-01-22T05:16:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11602025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
11612025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11622025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
11632025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
11642025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
11652025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
11662025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11672025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11682025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
11692025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11702025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11712025-01-22T05:16:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11722025-01-22T05:16:02.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11732025-01-22T05:16:02.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11742025-01-22T05:16:02.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11752025-01-22T05:16:02.878ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11762025-01-22T05:16:02.878ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11772025-01-22T05:16:02.878ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11782025-01-22T05:16:02.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11792025-01-22T05:16:02.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802025-01-22T05:16:02.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11812025-01-22T05:16:02.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11822025-01-22T05:16:02.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11832025-01-22T05:16:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11842025-01-22T05:16:02.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11852025-01-22T05:16:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11862025-01-22T05:16:02.882ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11872025-01-22T05:16:02.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11882025-01-22T05:16:02.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11892025-01-22T05:16:02.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11902025-01-22T05:16:02.883ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11912025-01-22T05:16:02.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11922025-01-22T05:16:02.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.923592ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11932025-01-22T05:16:02.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11942025-01-22T05:16:02.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952025-01-22T05:16:02.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11962025-01-22T05:16:02.885ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11972025-01-22T05:16:02.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11982025-01-22T05:16:02.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11992025-01-22T05:16:02.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12002025-01-22T05:16:02.887ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12012025-01-22T05:16:02.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12022025-01-22T05:16:02.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.63686ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
12032025-01-22T05:16:02.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
12042025-01-22T05:16:02.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12052025-01-22T05:16:02.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12062025-01-22T05:16:02.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 47505088-6b1a-42d0-b98c-a66f45ee79f0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
12072025-01-22T05:16:02.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 47505088-6b1a-42d0-b98c-a66f45ee79f0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
12082025-01-22T05:16:02.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 47505088-6b1a-42d0-b98c-a66f45ee79f0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
12092025-01-22T05:16:02.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.833786ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
12102025-01-22T05:16:02.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12112025-01-22T05:16:02.897ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12122025-01-22T05:16:02.897ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.270234ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12132025-01-22T05:16:02.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12142025-01-22T05:16:02.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 55.852467ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
12152025-01-22T05:16:02.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12162025-01-22T05:16:02.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12172025-01-22T05:16:02.905ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
12182025-01-22T05:16:02.905ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.647735ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
12192025-01-22T05:16:02.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12202025-01-22T05:16:02.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12212025-01-22T05:16:02.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12222025-01-22T05:16:02.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12232025-01-22T05:16:02.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12242025-01-22T05:16:02.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.64509ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12252025-01-22T05:16:02.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
12262025-01-22T05:16:02.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12272025-01-22T05:16:02.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12282025-01-22T05:16:02.924ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12292025-01-22T05:16:02.924ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12302025-01-22T05:16:02.924ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12312025-01-22T05:16:02.925ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.141692ms iteration = 12 status = 0
12322025-01-22T05:16:02.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12332025-01-22T05:16:02.933ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
12342025-01-22T05:16:02.933ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12352025-01-22T05:16:02.934ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8ca03be-4654-4fa6-a5c5-16689a8b9d47", "content-length": "26", "date": "Wed, 22 Jan 2025 05:16:02 GMT"} })
12362025-01-22T05:16:02.934ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12372025-01-22T05:16:02.935ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
12382025-01-22T05:16:02.935ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 113.229746ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
12392025-01-22T05:16:02.935ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
12402025-01-22T05:16:02.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.725169ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12412025-01-22T05:16:02.963ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12422025-01-22T05:16:02.963ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12432025-01-22T05:16:02.963ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.165036ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12442025-01-22T05:16:02.981ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.769585ms iteration = 14 status = {"physical_disks_added":0}
12452025-01-22T05:16:03.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12462025-01-22T05:16:03.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12472025-01-22T05:16:03.006ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
12482025-01-22T05:16:03.006ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12492025-01-22T05:16:03.006ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c4e6239-021e-412e-840f-4adb9ae29fd1", "content-length": "26", "date": "Wed, 22 Jan 2025 05:16:02 GMT"} })
12502025-01-22T05:16:03.006ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12512025-01-22T05:16:03.007ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12522025-01-22T05:16:03.032ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
12532025-01-22T05:16:03.032ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12542025-01-22T05:16:03.032ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "93ac8cae-c329-4b53-9191-e28fe0f2c6e3", "content-length": "26", "date": "Wed, 22 Jan 2025 05:16:02 GMT"} })
12552025-01-22T05:16:03.032ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12562025-01-22T05:16:03.034ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12572025-01-22T05:16:03.038ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12582025-01-22T05:16:03.038ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12592025-01-22T05:16:03.038ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "779f493a-a39b-464a-9a78-8e58f029f9fb", "content-length": "372", "date": "Wed, 22 Jan 2025 05:16:02 GMT"} })
12602025-01-22T05:16:03.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12612025-01-22T05:16:03.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12622025-01-22T05:16:03.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12632025-01-22T05:16:03.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12642025-01-22T05:16:03.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12652025-01-22T05:16:03.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12662025-01-22T05:16:03.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672025-01-22T05:16:03.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12682025-01-22T05:16:03.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12692025-01-22T05:16:03.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12702025-01-22T05:16:03.079ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
12712025-01-22T05:16:03.079ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12722025-01-22T05:16:03.080ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4bd148ac-95dc-430c-a9f2-f60b78759e10", "date": "Wed, 22 Jan 2025 05:16:02 GMT"} })
12732025-01-22T05:16:03.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12742025-01-22T05:16:03.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12752025-01-22T05:16:03.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12762025-01-22T05:16:03.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12772025-01-22T05:16:03.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12782025-01-22T05:16:03.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12792025-01-22T05:16:03.176ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12802025-01-22T05:16:03.177ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "71910bc5-2edd-4f7c-9074-67d113e3f232", "content-length": "691", "date": "Wed, 22 Jan 2025 05:16:02 GMT"} })
12812025-01-22T05:16:03.177ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
12822025-01-22T05:16:03.177ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
12832025-01-22T05:16:03.177ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
12842025-01-22T05:16:03.177ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 355.879689ms iteration = 12 status = {}
12852025-01-22T05:16:03.180ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12862025-01-22T05:16:03.180ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12872025-01-22T05:16:03.180ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "65372e64-f8ef-4050-9f19-ba7ca1106464", "date": "Wed, 22 Jan 2025 05:16:02 GMT"} })
12882025-01-22T05:16:03.181ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.687597ms iteration = 12 status = {}
12892025-01-22T05:16:03.216ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 394.810443ms iteration = 12 status = {}
12902025-01-22T05:16:03.225ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12912025-01-22T05:16:03.225ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "12c1a8a6-0196-46a6-a44a-8052c57da0f9", "content-length": "1", "date": "Wed, 22 Jan 2025 05:16:03 GMT"} })
12922025-01-22T05:16:03.228ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12932025-01-22T05:16:03.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12942025-01-22T05:16:03.229ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 407.832418ms iteration = 12 status = null
12952025-01-22T05:16:03.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12962025-01-22T05:16:03.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12972025-01-22T05:16:03.239ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
12982025-01-22T05:16:03.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12992025-01-22T05:16:03.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13002025-01-22T05:16:03.249ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13012025-01-22T05:16:03.249ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2ab67e3-44e5-4c41-98f1-70c58bb9c352", "content-length": "134", "date": "Wed, 22 Jan 2025 05:16:03 GMT"} })
13022025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13032025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
13042025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13052025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13062025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13072025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13082025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13092025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13102025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13112025-01-22T05:16:03.249ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13122025-01-22T05:16:03.250ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
13132025-01-22T05:16:03.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13142025-01-22T05:16:03.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13152025-01-22T05:16:03.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13162025-01-22T05:16:03.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "02d78021-1fd8-4bd9-8f8d-c65bb6b3e3a0", "content-length": "2", "date": "Wed, 22 Jan 2025 05:16:03 GMT"} })
13172025-01-22T05:16:03.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13182025-01-22T05:16:03.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f7c91c4-8f57-4332-9628-81a47ac672b8", "content-length": "51", "date": "Wed, 22 Jan 2025 05:16:03 GMT"} })
13192025-01-22T05:16:03.252ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
13202025-01-22T05:16:03.252ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13212025-01-22T05:16:03.350ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3757d7d7-76e2-47f2-b669-ed65e82b0e36", "date": "Wed, 22 Jan 2025 05:16:02 GMT"} })
13222025-01-22T05:16:03.350ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
13232025-01-22T05:16:03.350ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13242025-01-22T05:16:03.350ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "98760be7-97f3-4205-9507-871db12503c9", "content-length": "682", "date": "Wed, 22 Jan 2025 05:16:02 GMT"} })
13252025-01-22T05:16:03.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13262025-01-22T05:16:03.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13272025-01-22T05:16:03.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13282025-01-22T05:16:03.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13292025-01-22T05:16:03.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13302025-01-22T05:16:03.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13312025-01-22T05:16:03.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13322025-01-22T05:16:03.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13332025-01-22T05:16:03.367ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.929201ms iteration = 12 status = {}
13342025-01-22T05:16:04.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 30d2d9b3-1d59-4dfc-bb8b-16d8b794a7a3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13352025-01-22T05:16:04.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 30d2d9b3-1d59-4dfc-bb8b-16d8b794a7a3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13362025-01-22T05:16:04.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 30d2d9b3-1d59-4dfc-bb8b-16d8b794a7a3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13372025-01-22T05:16:04.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 911c2b03-387e-4fe5-ba5a-331156eed792 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13382025-01-22T05:16:04.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 911c2b03-387e-4fe5-ba5a-331156eed792 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13392025-01-22T05:16:04.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 911c2b03-387e-4fe5-ba5a-331156eed792 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13402025-01-22T05:16:05.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 758ba1c9-4030-4f55-a6e4-e129e83f1aae roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13412025-01-22T05:16:05.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 758ba1c9-4030-4f55-a6e4-e129e83f1aae resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13422025-01-22T05:16:05.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 758ba1c9-4030-4f55-a6e4-e129e83f1aae response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13432025-01-22T05:16:05.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 887 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 99e0889c-e001-4b64-bfa1-e00f160f9297 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
13442025-01-22T05:16:06.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0b3959d4-c9ed-4b5a-994d-afabf7c89fde roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13452025-01-22T05:16:06.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0b3959d4-c9ed-4b5a-994d-afabf7c89fde resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13462025-01-22T05:16:06.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0b3959d4-c9ed-4b5a-994d-afabf7c89fde response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13472025-01-22T05:16:07.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 32d91094-22e3-4b94-a403-f63423e858f0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13482025-01-22T05:16:07.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 32d91094-22e3-4b94-a403-f63423e858f0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13492025-01-22T05:16:07.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 32d91094-22e3-4b94-a403-f63423e858f0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13502025-01-22T05:16:08.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 15f75091-a618-456f-8844-d80b83215466 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13512025-01-22T05:16:08.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 15f75091-a618-456f-8844-d80b83215466 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13522025-01-22T05:16:08.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 15f75091-a618-456f-8844-d80b83215466 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13532025-01-22T05:16:09.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a14adbe-2f36-414c-8993-ea5359742f2c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13542025-01-22T05:16:09.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a14adbe-2f36-414c-8993-ea5359742f2c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13552025-01-22T05:16:09.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a14adbe-2f36-414c-8993-ea5359742f2c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13562025-01-22T05:16:10.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5bbd32d3-36d0-439e-99c3-b18e77a20dd5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13572025-01-22T05:16:10.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5bbd32d3-36d0-439e-99c3-b18e77a20dd5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13582025-01-22T05:16:10.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5bbd32d3-36d0-439e-99c3-b18e77a20dd5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13592025-01-22T05:16:11.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b62d3921-222e-4766-9acd-2b4dd8c38522 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13602025-01-22T05:16:11.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b62d3921-222e-4766-9acd-2b4dd8c38522 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13612025-01-22T05:16:11.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b62d3921-222e-4766-9acd-2b4dd8c38522 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13622025-01-22T05:16:12.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7ff4cab5-5007-4ea4-92b0-6d7c73a8a524 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13632025-01-22T05:16:12.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7ff4cab5-5007-4ea4-92b0-6d7c73a8a524 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13642025-01-22T05:16:12.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7ff4cab5-5007-4ea4-92b0-6d7c73a8a524 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13652025-01-22T05:16:12.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
13662025-01-22T05:16:12.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13672025-01-22T05:16:12.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13682025-01-22T05:16:12.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
13692025-01-22T05:16:12.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13702025-01-22T05:16:12.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13712025-01-22T05:16:12.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13722025-01-22T05:16:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13732025-01-22T05:16:12.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13742025-01-22T05:16:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13752025-01-22T05:16:12.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13762025-01-22T05:16:12.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13772025-01-22T05:16:12.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13782025-01-22T05:16:12.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13792025-01-22T05:16:12.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13802025-01-22T05:16:12.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
13812025-01-22T05:16:12.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13822025-01-22T05:16:12.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13832025-01-22T05:16:12.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
13842025-01-22T05:16:12.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.407729ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
13852025-01-22T05:16:12.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.333172ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13862025-01-22T05:16:13.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1525261f-e89e-475c-96d7-249aadfb1534 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13872025-01-22T05:16:13.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1525261f-e89e-475c-96d7-249aadfb1534 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13882025-01-22T05:16:13.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1525261f-e89e-475c-96d7-249aadfb1534 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13892025-01-22T05:16:14.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f9ee4e96-290d-4c3e-ab2f-64ca98e56d4a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13902025-01-22T05:16:14.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f9ee4e96-290d-4c3e-ab2f-64ca98e56d4a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13912025-01-22T05:16:14.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f9ee4e96-290d-4c3e-ab2f-64ca98e56d4a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13922025-01-22T05:16:15.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1cdf348-c841-4455-99b7-381685b6bbce roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13932025-01-22T05:16:15.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1cdf348-c841-4455-99b7-381685b6bbce resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13942025-01-22T05:16:15.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1cdf348-c841-4455-99b7-381685b6bbce response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13952025-01-22T05:16:15.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 92aeafd0-81bb-4bb2-9b7d-66a5eb0fd2fb response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
13962025-01-22T05:16:16.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b44b9ff4-cbf3-4a6a-8795-1ee329c40450 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13972025-01-22T05:16:16.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b44b9ff4-cbf3-4a6a-8795-1ee329c40450 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13982025-01-22T05:16:16.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b44b9ff4-cbf3-4a6a-8795-1ee329c40450 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
13992025-01-22T05:16:17.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1f777b45-873e-4f07-872c-fb0ed9afc419 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14002025-01-22T05:16:17.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1f777b45-873e-4f07-872c-fb0ed9afc419 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14012025-01-22T05:16:17.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1f777b45-873e-4f07-872c-fb0ed9afc419 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14022025-01-22T05:16:18.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4dc619dd-f07f-4410-bc3f-f98721ca616a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14032025-01-22T05:16:18.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4dc619dd-f07f-4410-bc3f-f98721ca616a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14042025-01-22T05:16:18.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4dc619dd-f07f-4410-bc3f-f98721ca616a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14052025-01-22T05:16:19.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dfb0c36e-e90e-4de5-8d76-4f6322f142cb roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14062025-01-22T05:16:19.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dfb0c36e-e90e-4de5-8d76-4f6322f142cb resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14072025-01-22T05:16:19.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dfb0c36e-e90e-4de5-8d76-4f6322f142cb response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14082025-01-22T05:16:20.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8c2f0a44-37b0-4f0c-8925-535b5eb6474b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14092025-01-22T05:16:20.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8c2f0a44-37b0-4f0c-8925-535b5eb6474b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14102025-01-22T05:16:20.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8c2f0a44-37b0-4f0c-8925-535b5eb6474b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14112025-01-22T05:16:21.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 36295ca1-3466-4f25-b6c1-0cab3234b5a3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14122025-01-22T05:16:21.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 36295ca1-3466-4f25-b6c1-0cab3234b5a3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14132025-01-22T05:16:21.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 36295ca1-3466-4f25-b6c1-0cab3234b5a3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14142025-01-22T05:16:22.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f431cb1-cc92-420f-a81d-60ba8bdf7144 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14152025-01-22T05:16:22.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f431cb1-cc92-420f-a81d-60ba8bdf7144 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14162025-01-22T05:16:22.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f431cb1-cc92-420f-a81d-60ba8bdf7144 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14172025-01-22T05:16:22.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
14182025-01-22T05:16:22.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14192025-01-22T05:16:22.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14202025-01-22T05:16:22.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
14212025-01-22T05:16:22.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14222025-01-22T05:16:22.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14232025-01-22T05:16:22.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14242025-01-22T05:16:22.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14252025-01-22T05:16:22.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14262025-01-22T05:16:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14272025-01-22T05:16:22.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14282025-01-22T05:16:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14292025-01-22T05:16:22.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14302025-01-22T05:16:22.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14312025-01-22T05:16:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14322025-01-22T05:16:22.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
14332025-01-22T05:16:22.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14342025-01-22T05:16:22.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14352025-01-22T05:16:22.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
14362025-01-22T05:16:22.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.726022ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
14372025-01-22T05:16:22.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.552684ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14382025-01-22T05:16:23.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = be33f689-f88b-4b17-b3d4-5fb955946ff9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14392025-01-22T05:16:23.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = be33f689-f88b-4b17-b3d4-5fb955946ff9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14402025-01-22T05:16:23.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = be33f689-f88b-4b17-b3d4-5fb955946ff9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14412025-01-22T05:16:24.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3eea1b6e-b089-410a-a873-f1ebc7b63108 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14422025-01-22T05:16:24.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3eea1b6e-b089-410a-a873-f1ebc7b63108 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14432025-01-22T05:16:24.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3eea1b6e-b089-410a-a873-f1ebc7b63108 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14442025-01-22T05:16:25.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d0659ffc-e4e6-465d-937f-9b9a268faaa5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14452025-01-22T05:16:25.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d0659ffc-e4e6-465d-937f-9b9a268faaa5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14462025-01-22T05:16:25.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d0659ffc-e4e6-465d-937f-9b9a268faaa5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14472025-01-22T05:16:25.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 901 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = e036de2d-c88c-4683-a446-310d89e93dfa response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
14482025-01-22T05:16:26.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 922d36ca-5bad-4b14-98fe-c16c3738379a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14492025-01-22T05:16:26.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 922d36ca-5bad-4b14-98fe-c16c3738379a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14502025-01-22T05:16:26.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 922d36ca-5bad-4b14-98fe-c16c3738379a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14512025-01-22T05:16:27.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3dfe1c32-acdc-4fe1-8d57-9b7cc99ed4ed roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14522025-01-22T05:16:27.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3dfe1c32-acdc-4fe1-8d57-9b7cc99ed4ed resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14532025-01-22T05:16:27.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3dfe1c32-acdc-4fe1-8d57-9b7cc99ed4ed response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14542025-01-22T05:16:28.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1803f223-50ca-42d0-b403-d566b4c7bbff roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14552025-01-22T05:16:28.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1803f223-50ca-42d0-b403-d566b4c7bbff resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14562025-01-22T05:16:28.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1803f223-50ca-42d0-b403-d566b4c7bbff response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14572025-01-22T05:16:29.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ae612151-bfe8-479d-aa2b-f5240f8cb1a0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14582025-01-22T05:16:29.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ae612151-bfe8-479d-aa2b-f5240f8cb1a0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14592025-01-22T05:16:29.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ae612151-bfe8-479d-aa2b-f5240f8cb1a0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14602025-01-22T05:16:30.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0e7b67b8-d1ab-4b7a-ae0b-06329953e25d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14612025-01-22T05:16:30.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0e7b67b8-d1ab-4b7a-ae0b-06329953e25d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14622025-01-22T05:16:30.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0e7b67b8-d1ab-4b7a-ae0b-06329953e25d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14632025-01-22T05:16:31.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50f8ac32-cbd4-44de-bece-4de51fca1bc9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14642025-01-22T05:16:31.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50f8ac32-cbd4-44de-bece-4de51fca1bc9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14652025-01-22T05:16:31.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50f8ac32-cbd4-44de-bece-4de51fca1bc9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14662025-01-22T05:16:32.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50b55b84-684d-42e7-8a8f-840697cbc4d8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14672025-01-22T05:16:32.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50b55b84-684d-42e7-8a8f-840697cbc4d8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14682025-01-22T05:16:32.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50b55b84-684d-42e7-8a8f-840697cbc4d8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
14692025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
14702025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
14712025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
14722025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14732025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
14742025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
14752025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14762025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14772025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
14782025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
14792025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14802025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
14812025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
14822025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14832025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
14842025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14852025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
14862025-01-22T05:16:32.821ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14872025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
14882025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14892025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
14902025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14912025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
14922025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14932025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
14942025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14952025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
14962025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14972025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14982025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
14992025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
15002025-01-22T05:16:32.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15012025-01-22T05:16:32.821ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:06:32.821862449 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
15022025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
15032025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
15042025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
15052025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15062025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
15072025-01-22T05:16:32.822ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
15082025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.73\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
15092025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
15102025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15112025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15122025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15132025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15142025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15152025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15162025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15172025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
15182025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
15192025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15202025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
15212025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
15222025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15232025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15242025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15252025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
15262025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15272025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
15282025-01-22T05:16:32.822ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15292025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15302025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15312025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15322025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15332025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
15342025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15352025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
15362025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15372025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15382025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15392025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15402025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15412025-01-22T05:16:32.822ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11175, tv_nsec: 171828045 } })
15422025-01-22T05:16:32.822ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11175, tv_nsec: 171847565 } })
15432025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15442025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15452025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15462025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15472025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15482025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15492025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15502025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15512025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15522025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15532025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15542025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15552025-01-22T05:16:32.822ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
15562025-01-22T05:16:32.823ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.205744ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
15572025-01-22T05:16:32.823ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15582025-01-22T05:16:32.823ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.406008ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15592025-01-22T05:16:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15602025-01-22T05:16:32.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612025-01-22T05:16:32.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622025-01-22T05:16:32.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15632025-01-22T05:16:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15642025-01-22T05:16:32.826ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15652025-01-22T05:16:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15662025-01-22T05:16:32.826ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.693666ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15672025-01-22T05:16:32.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11175, tv_nsec: 176268835 } })
15682025-01-22T05:16:32.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
15692025-01-22T05:16:32.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15702025-01-22T05:16:32.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15712025-01-22T05:16:32.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15722025-01-22T05:16:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15732025-01-22T05:16:32.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15742025-01-22T05:16:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15752025-01-22T05:16:32.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15762025-01-22T05:16:32.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15772025-01-22T05:16:32.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15782025-01-22T05:16:32.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792025-01-22T05:16:32.831ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:06:32.821862449 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15802025-01-22T05:16:32.831ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.514904ms iteration = 7 status = {"expiration":"2025-01-22T05:06:32.821862449Z","pruned":[]}
15812025-01-22T05:16:32.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15822025-01-22T05:16:32.831ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15832025-01-22T05:16:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15842025-01-22T05:16:32.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15852025-01-22T05:16:32.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15862025-01-22T05:16:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15872025-01-22T05:16:32.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15882025-01-22T05:16:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15892025-01-22T05:16:32.834ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902025-01-22T05:16:32.835ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11175, tv_nsec: 184772959 } })
15912025-01-22T05:16:32.835ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
15922025-01-22T05:16:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
15932025-01-22T05:16:32.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15942025-01-22T05:16:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15952025-01-22T05:16:32.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15962025-01-22T05:16:32.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15972025-01-22T05:16:32.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15982025-01-22T05:16:32.840ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15992025-01-22T05:16:32.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16002025-01-22T05:16:32.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16012025-01-22T05:16:32.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16022025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16032025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16042025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16052025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
16062025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
16072025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
16082025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16092025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16102025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16112025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
16122025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
16132025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16142025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
16152025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16162025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16172025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16182025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16192025-01-22T05:16:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
16202025-01-22T05:16:32.845ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11175, tv_nsec: 194480606 } })
16212025-01-22T05:16:32.845ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
16222025-01-22T05:16:32.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16232025-01-22T05:16:32.846ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16242025-01-22T05:16:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16252025-01-22T05:16:32.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16262025-01-22T05:16:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16272025-01-22T05:16:32.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16282025-01-22T05:16:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16292025-01-22T05:16:32.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16302025-01-22T05:16:32.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16312025-01-22T05:16:32.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16322025-01-22T05:16:32.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16332025-01-22T05:16:32.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16342025-01-22T05:16:32.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16352025-01-22T05:16:32.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16362025-01-22T05:16:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16372025-01-22T05:16:32.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
16382025-01-22T05:16:32.855ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16392025-01-22T05:16:32.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16402025-01-22T05:16:32.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.947864ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
16412025-01-22T05:16:32.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 25.594511ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
16422025-01-22T05:16:32.872ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 29.159834ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
16432025-01-22T05:16:32.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16442025-01-22T05:16:32.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16452025-01-22T05:16:32.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16462025-01-22T05:16:32.878ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16472025-01-22T05:16:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16482025-01-22T05:16:32.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16492025-01-22T05:16:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16502025-01-22T05:16:32.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16512025-01-22T05:16:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
16522025-01-22T05:16:32.882ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16532025-01-22T05:16:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16542025-01-22T05:16:32.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16552025-01-22T05:16:32.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16562025-01-22T05:16:32.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16572025-01-22T05:16:32.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16582025-01-22T05:16:32.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16592025-01-22T05:16:32.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16602025-01-22T05:16:32.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16612025-01-22T05:16:32.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16622025-01-22T05:16:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16632025-01-22T05:16:32.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16642025-01-22T05:16:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
16652025-01-22T05:16:32.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16662025-01-22T05:16:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16672025-01-22T05:16:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16682025-01-22T05:16:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16692025-01-22T05:16:32.888ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16702025-01-22T05:16:32.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16712025-01-22T05:16:32.889ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16722025-01-22T05:16:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16732025-01-22T05:16:32.891ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16742025-01-22T05:16:32.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16752025-01-22T05:16:32.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16762025-01-22T05:16:32.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16772025-01-22T05:16:32.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16782025-01-22T05:16:32.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16792025-01-22T05:16:32.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.989756ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16802025-01-22T05:16:32.893ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16812025-01-22T05:16:32.894ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16822025-01-22T05:16:32.894ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16832025-01-22T05:16:32.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16842025-01-22T05:16:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16852025-01-22T05:16:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16862025-01-22T05:16:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16872025-01-22T05:16:32.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16882025-01-22T05:16:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16892025-01-22T05:16:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16902025-01-22T05:16:32.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16912025-01-22T05:16:32.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16922025-01-22T05:16:32.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16932025-01-22T05:16:32.900ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 79.144602ms iteration = 4 status = {"nsuccess":5}
16942025-01-22T05:16:32.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16952025-01-22T05:16:32.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16962025-01-22T05:16:32.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16972025-01-22T05:16:32.902ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
16982025-01-22T05:16:32.902ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
16992025-01-22T05:16:32.902ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.565931ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
17002025-01-22T05:16:32.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17012025-01-22T05:16:32.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17022025-01-22T05:16:32.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17032025-01-22T05:16:32.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17042025-01-22T05:16:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17052025-01-22T05:16:32.908ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
17062025-01-22T05:16:32.908ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
17072025-01-22T05:16:32.908ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17082025-01-22T05:16:32.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17092025-01-22T05:16:32.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17102025-01-22T05:16:32.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
17112025-01-22T05:16:32.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17122025-01-22T05:16:32.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17132025-01-22T05:16:32.921ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17142025-01-22T05:16:32.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17152025-01-22T05:16:32.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17162025-01-22T05:16:32.926ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.020169ms iteration = 13 status = 0
17172025-01-22T05:16:32.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17182025-01-22T05:16:32.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17192025-01-22T05:16:32.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17202025-01-22T05:16:32.929ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17212025-01-22T05:16:32.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17222025-01-22T05:16:32.935ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
17232025-01-22T05:16:32.935ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 113.622795ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
17242025-01-22T05:16:32.935ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
17252025-01-22T05:16:32.935ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.953451ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
17262025-01-22T05:16:32.939ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
17272025-01-22T05:16:32.942ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
17282025-01-22T05:16:32.943ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
17292025-01-22T05:16:32.943ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
17302025-01-22T05:16:32.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17312025-01-22T05:16:32.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17322025-01-22T05:16:32.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17332025-01-22T05:16:32.946ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17342025-01-22T05:16:32.946ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17352025-01-22T05:16:32.946ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17362025-01-22T05:16:32.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17372025-01-22T05:16:32.946ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17382025-01-22T05:16:32.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17392025-01-22T05:16:32.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17402025-01-22T05:16:32.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 124.987546ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17412025-01-22T05:16:32.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17422025-01-22T05:16:32.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17432025-01-22T05:16:32.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17442025-01-22T05:16:32.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17452025-01-22T05:16:32.949ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17462025-01-22T05:16:32.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17472025-01-22T05:16:32.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17482025-01-22T05:16:32.949ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17492025-01-22T05:16:32.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17502025-01-22T05:16:32.950ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17512025-01-22T05:16:32.952ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
17522025-01-22T05:16:32.952ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
17532025-01-22T05:16:32.952ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 130.363145ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
17542025-01-22T05:16:32.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17552025-01-22T05:16:32.952ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17562025-01-22T05:16:32.952ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17572025-01-22T05:16:32.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17582025-01-22T05:16:32.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17592025-01-22T05:16:32.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17602025-01-22T05:16:32.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17612025-01-22T05:16:32.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
17622025-01-22T05:16:32.956ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17632025-01-22T05:16:32.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 113.469302ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17642025-01-22T05:16:32.957ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb97d656-d348-4259-b2c6-b71416f7038b", "content-length": "26", "date": "Wed, 22 Jan 2025 05:16:32 GMT"} })
17652025-01-22T05:16:32.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17662025-01-22T05:16:32.958ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17672025-01-22T05:16:32.962ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17682025-01-22T05:16:32.962ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.194056ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17692025-01-22T05:16:32.963ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17702025-01-22T05:16:32.963ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17712025-01-22T05:16:32.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17722025-01-22T05:16:32.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17732025-01-22T05:16:32.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17742025-01-22T05:16:32.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17752025-01-22T05:16:32.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17762025-01-22T05:16:32.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17772025-01-22T05:16:32.972ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17782025-01-22T05:16:32.972ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17792025-01-22T05:16:32.972ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
17802025-01-22T05:16:32.972ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 150.318391ms iteration = 7 status = {"generation":1}
17812025-01-22T05:16:32.974ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
17822025-01-22T05:16:32.974ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17832025-01-22T05:16:32.974ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaa9d235-04db-4a49-9e87-d4918e8c090e", "content-length": "26", "date": "Wed, 22 Jan 2025 05:16:32 GMT"} })
17842025-01-22T05:16:32.974ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17852025-01-22T05:16:32.976ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17862025-01-22T05:16:32.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
17872025-01-22T05:16:32.979ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17882025-01-22T05:16:32.979ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7df81f11-712b-4e44-aaea-335ba0ab9d26", "content-length": "26", "date": "Wed, 22 Jan 2025 05:16:32 GMT"} })
17892025-01-22T05:16:32.979ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17902025-01-22T05:16:32.980ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
17912025-01-22T05:16:32.980ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
17922025-01-22T05:16:32.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17932025-01-22T05:16:32.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17942025-01-22T05:16:32.981ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
17952025-01-22T05:16:32.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.375039ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
17962025-01-22T05:16:32.982ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17972025-01-22T05:16:32.982ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17982025-01-22T05:16:32.982ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.855307ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17992025-01-22T05:16:33.004ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
18002025-01-22T05:16:33.004ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 182.513108ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
18012025-01-22T05:16:33.021ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
18022025-01-22T05:16:33.021ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 199.473394ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
18032025-01-22T05:16:33.035ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 213.971199ms iteration = 15 status = {"physical_disks_added":0}
18042025-01-22T05:16:33.106ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
18052025-01-22T05:16:33.138ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18062025-01-22T05:16:33.139ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddf9cfc0-c723-4827-9298-a6a14f4070d3", "content-length": "691", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
18072025-01-22T05:16:33.139ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
18082025-01-22T05:16:33.139ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
18092025-01-22T05:16:33.139ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
18102025-01-22T05:16:33.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18112025-01-22T05:16:33.140ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 318.917226ms iteration = 13 status = {}
18122025-01-22T05:16:33.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18132025-01-22T05:16:33.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18142025-01-22T05:16:33.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18152025-01-22T05:16:33.157ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
18162025-01-22T05:16:33.158ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "937ef40d-06b7-401b-9fd7-0759de27db91", "date": "Wed, 22 Jan 2025 05:16:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18172025-01-22T05:16:33.158ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18182025-01-22T05:16:33.159ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "107b9857-5adb-4269-80f2-440207ef5142", "date": "Wed, 22 Jan 2025 05:16:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18192025-01-22T05:16:33.159ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18202025-01-22T05:16:33.160ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18212025-01-22T05:16:33.160ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 338.71616ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
18222025-01-22T05:16:33.202ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18232025-01-22T05:16:33.202ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18242025-01-22T05:16:33.202ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb390e2e-a3d6-412a-844e-e2aa0161d836", "content-length": "372", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
18252025-01-22T05:16:33.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18262025-01-22T05:16:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18272025-01-22T05:16:33.204ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
18282025-01-22T05:16:33.204ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18292025-01-22T05:16:33.204ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
18302025-01-22T05:16:33.204ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 382.350008ms iteration = 7 status = {"generation":2}
18312025-01-22T05:16:33.222ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
18322025-01-22T05:16:33.222ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18332025-01-22T05:16:33.223ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8b08cfcd-2d84-4796-92fd-ccf8bff35e89", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
18342025-01-22T05:16:33.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18352025-01-22T05:16:33.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18362025-01-22T05:16:33.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18372025-01-22T05:16:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18382025-01-22T05:16:33.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18392025-01-22T05:16:33.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18402025-01-22T05:16:33.232ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18412025-01-22T05:16:33.232ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18422025-01-22T05:16:33.232ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "31e1b96a-2ae0-46bf-9ad7-56554fece728", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
18432025-01-22T05:16:33.233ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 411.359579ms iteration = 13 status = {}
18442025-01-22T05:16:33.239ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 418.099337ms iteration = 13 status = {}
18452025-01-22T05:16:33.240ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
18462025-01-22T05:16:33.240ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d7ba767e-a973-44ab-9cba-380c9f0cd112", "date": "Wed, 22 Jan 2025 05:16:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
18472025-01-22T05:16:33.240ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
18482025-01-22T05:16:33.242ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ca4b0af4-b2eb-4551-8872-6698d3368e8b", "date": "Wed, 22 Jan 2025 05:16:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
18492025-01-22T05:16:33.242ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
18502025-01-22T05:16:33.244ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d208f612-a107-4c1a-88b4-a45d988eaa79", "date": "Wed, 22 Jan 2025 05:16:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
18512025-01-22T05:16:33.244ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
18522025-01-22T05:16:33.246ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
18532025-01-22T05:16:33.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 424.786873ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
18542025-01-22T05:16:33.247ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18552025-01-22T05:16:33.247ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c20d21e8-a588-4a27-9fd2-7fa85238579b", "content-length": "1", "date": "Wed, 22 Jan 2025 05:16:32 GMT"} })
18562025-01-22T05:16:33.249ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18572025-01-22T05:16:33.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18582025-01-22T05:16:33.251ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 429.585301ms iteration = 13 status = null
18592025-01-22T05:16:33.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18602025-01-22T05:16:33.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18612025-01-22T05:16:33.294ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
18622025-01-22T05:16:33.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18632025-01-22T05:16:33.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18642025-01-22T05:16:33.304ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18652025-01-22T05:16:33.304ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b24dadbd-4ae9-4c23-8f90-228b2b0023fd", "content-length": "134", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
18662025-01-22T05:16:33.304ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18672025-01-22T05:16:33.304ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
18682025-01-22T05:16:33.305ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18692025-01-22T05:16:33.305ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18702025-01-22T05:16:33.305ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18712025-01-22T05:16:33.305ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18722025-01-22T05:16:33.305ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18732025-01-22T05:16:33.305ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18742025-01-22T05:16:33.305ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18752025-01-22T05:16:33.305ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18762025-01-22T05:16:33.305ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
18772025-01-22T05:16:33.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18782025-01-22T05:16:33.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18792025-01-22T05:16:33.307ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18802025-01-22T05:16:33.307ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "812e4dcd-c5c4-4f42-a105-10f2c90491e1", "content-length": "2", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
18812025-01-22T05:16:33.307ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18822025-01-22T05:16:33.307ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ab39b1c-f416-41ae-849c-0e3d9d656045", "content-length": "51", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
18832025-01-22T05:16:33.307ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
18842025-01-22T05:16:33.307ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18852025-01-22T05:16:33.443ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ceeb795c-7c46-4dcc-ad81-27441fb0ce60", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
18862025-01-22T05:16:33.443ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
18872025-01-22T05:16:33.443ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18882025-01-22T05:16:33.443ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae205318-2153-45c2-8955-94d2caefe645", "content-length": "682", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
18892025-01-22T05:16:33.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18902025-01-22T05:16:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18912025-01-22T05:16:33.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18922025-01-22T05:16:33.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18932025-01-22T05:16:33.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18942025-01-22T05:16:33.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18952025-01-22T05:16:33.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18962025-01-22T05:16:33.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18972025-01-22T05:16:33.459ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 637.533287ms iteration = 13 status = {}
18982025-01-22T05:16:33.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 937f41b8-cf2b-4b38-b799-0463578df1f4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
18992025-01-22T05:16:33.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 937f41b8-cf2b-4b38-b799-0463578df1f4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19002025-01-22T05:16:33.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 937f41b8-cf2b-4b38-b799-0463578df1f4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19012025-01-22T05:16:33.729ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
19022025-01-22T05:16:33.729ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
19032025-01-22T05:16:33.759ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
19042025-01-22T05:16:33.759ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:43616
19052025-01-22T05:16:33.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43616 req_id = 760c67e8-ce14-44fc-80c3-867e00360459 roles = RoleSet { roles: {} } uri = /metrics/producers
19062025-01-22T05:16:33.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43616 req_id = 760c67e8-ce14-44fc-80c3-867e00360459 resource = Database result = Ok(()) uri = /metrics/producers
19072025-01-22T05:16:33.797ZINFOnexus: assigned collector to new producer collector_id = 95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0 file = nexus/src/app/oximeter.rs:76 producer_id = 3fbe3917-aca1-4b36-8119-948b03a24746
19082025-01-22T05:16:33.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37690 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43616 req_id = 760c67e8-ce14-44fc-80c3-867e00360459 response_code = 201 uri = /metrics/producers
19092025-01-22T05:16:33.797ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "760c67e8-ce14-44fc-80c3-867e00360459", "content-length": "41", "date": "Wed, 22 Jan 2025 05:16:33 GMT"} })
19102025-01-22T05:16:33.799ZDEBGnexus (producer-registration-task): registered with nexus successfully
19112025-01-22T05:16:33.799ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
19122025-01-22T05:16:34.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 6bb2b693-b8e1-4f00-98c6-dff3657e706b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
19132025-01-22T05:16:34.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 6bb2b693-b8e1-4f00-98c6-dff3657e706b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
19142025-01-22T05:16:34.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 6bb2b693-b8e1-4f00-98c6-dff3657e706b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
19152025-01-22T05:16:34.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0503538e-973b-46b9-b44e-949cb36f1beb roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19162025-01-22T05:16:34.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0503538e-973b-46b9-b44e-949cb36f1beb resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19172025-01-22T05:16:34.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0503538e-973b-46b9-b44e-949cb36f1beb response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19182025-01-22T05:16:35.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9f2007b0-12a5-4add-99ce-9b9e6242b25b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19192025-01-22T05:16:35.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9f2007b0-12a5-4add-99ce-9b9e6242b25b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19202025-01-22T05:16:35.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9f2007b0-12a5-4add-99ce-9b9e6242b25b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19212025-01-22T05:16:35.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 001479e8-55e9-4dde-9e0e-b10882cb134b response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
19222025-01-22T05:16:36.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ffbbbdd7-ed95-4685-9c4c-dfcce80fc655 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19232025-01-22T05:16:36.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ffbbbdd7-ed95-4685-9c4c-dfcce80fc655 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19242025-01-22T05:16:36.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ffbbbdd7-ed95-4685-9c4c-dfcce80fc655 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19252025-01-22T05:16:37.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4c72f825-e89d-40ef-8c44-f5dc934e0413 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19262025-01-22T05:16:37.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4c72f825-e89d-40ef-8c44-f5dc934e0413 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19272025-01-22T05:16:37.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4c72f825-e89d-40ef-8c44-f5dc934e0413 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19282025-01-22T05:16:38.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 619225a2-bced-4dbb-9d76-f18fe32541d2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19292025-01-22T05:16:38.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 619225a2-bced-4dbb-9d76-f18fe32541d2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19302025-01-22T05:16:38.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 619225a2-bced-4dbb-9d76-f18fe32541d2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19312025-01-22T05:16:39.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eedd0356-9d96-4914-94e2-f5643facc299 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19322025-01-22T05:16:39.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eedd0356-9d96-4914-94e2-f5643facc299 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19332025-01-22T05:16:39.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eedd0356-9d96-4914-94e2-f5643facc299 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19342025-01-22T05:16:40.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cf18d635-6ae4-442c-a75a-337ea80c2b4c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19352025-01-22T05:16:40.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cf18d635-6ae4-442c-a75a-337ea80c2b4c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19362025-01-22T05:16:40.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cf18d635-6ae4-442c-a75a-337ea80c2b4c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19372025-01-22T05:16:41.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 07a4b5e5-ff28-411f-b547-da26c7bda225 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19382025-01-22T05:16:41.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 07a4b5e5-ff28-411f-b547-da26c7bda225 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19392025-01-22T05:16:41.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 07a4b5e5-ff28-411f-b547-da26c7bda225 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19402025-01-22T05:16:42.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
19412025-01-22T05:16:42.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19422025-01-22T05:16:42.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19432025-01-22T05:16:42.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
19442025-01-22T05:16:42.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19452025-01-22T05:16:42.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19462025-01-22T05:16:42.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19472025-01-22T05:16:42.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19482025-01-22T05:16:42.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19492025-01-22T05:16:42.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19502025-01-22T05:16:42.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19512025-01-22T05:16:42.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19522025-01-22T05:16:42.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19532025-01-22T05:16:42.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
19542025-01-22T05:16:42.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19552025-01-22T05:16:42.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19562025-01-22T05:16:42.843ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
19572025-01-22T05:16:42.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.275644ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
19582025-01-22T05:16:42.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19592025-01-22T05:16:42.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19602025-01-22T05:16:42.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.787517ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19612025-01-22T05:16:42.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = df20a906-eb56-43b4-b780-bcd08c510f73 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19622025-01-22T05:16:42.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = df20a906-eb56-43b4-b780-bcd08c510f73 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19632025-01-22T05:16:42.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = df20a906-eb56-43b4-b780-bcd08c510f73 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19642025-01-22T05:16:43.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 049a785b-84ec-4512-87b5-868fd4832698 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19652025-01-22T05:16:43.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 049a785b-84ec-4512-87b5-868fd4832698 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19662025-01-22T05:16:43.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 049a785b-84ec-4512-87b5-868fd4832698 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19672025-01-22T05:16:44.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fafde852-6b79-40ee-aaec-d816621adf89 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19682025-01-22T05:16:44.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fafde852-6b79-40ee-aaec-d816621adf89 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19692025-01-22T05:16:44.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fafde852-6b79-40ee-aaec-d816621adf89 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19702025-01-22T05:16:45.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 69210483-eb72-480f-aecb-f342d0f4d09f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19712025-01-22T05:16:45.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 69210483-eb72-480f-aecb-f342d0f4d09f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19722025-01-22T05:16:45.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 69210483-eb72-480f-aecb-f342d0f4d09f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19732025-01-22T05:16:45.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 516 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 49ecc347-9b69-4a88-aaef-eeebe98f367f response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
19742025-01-22T05:16:46.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = de673fa6-48d3-45fd-87a5-018825d1cdb7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19752025-01-22T05:16:46.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = de673fa6-48d3-45fd-87a5-018825d1cdb7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19762025-01-22T05:16:46.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = de673fa6-48d3-45fd-87a5-018825d1cdb7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19772025-01-22T05:16:47.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4642f91c-9821-41af-942a-e35903d1d4d1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19782025-01-22T05:16:47.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4642f91c-9821-41af-942a-e35903d1d4d1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19792025-01-22T05:16:47.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4642f91c-9821-41af-942a-e35903d1d4d1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19802025-01-22T05:16:49.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 623842d9-7827-4953-8111-0b0a3f42802f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19812025-01-22T05:16:49.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 623842d9-7827-4953-8111-0b0a3f42802f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19822025-01-22T05:16:49.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 623842d9-7827-4953-8111-0b0a3f42802f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19832025-01-22T05:16:50.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 22a9abb8-79a1-40d3-8936-0117304c0ed9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19842025-01-22T05:16:50.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 22a9abb8-79a1-40d3-8936-0117304c0ed9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19852025-01-22T05:16:50.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 22a9abb8-79a1-40d3-8936-0117304c0ed9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19862025-01-22T05:16:51.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cfc3f50c-7b3d-4287-a206-5923f8708f92 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19872025-01-22T05:16:51.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cfc3f50c-7b3d-4287-a206-5923f8708f92 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19882025-01-22T05:16:51.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cfc3f50c-7b3d-4287-a206-5923f8708f92 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19892025-01-22T05:16:52.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1fdfb326-556c-4beb-be45-22e4b59ddb68 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19902025-01-22T05:16:52.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1fdfb326-556c-4beb-be45-22e4b59ddb68 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19912025-01-22T05:16:52.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1fdfb326-556c-4beb-be45-22e4b59ddb68 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
19922025-01-22T05:16:52.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
19932025-01-22T05:16:52.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19942025-01-22T05:16:52.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19952025-01-22T05:16:52.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
19962025-01-22T05:16:52.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19972025-01-22T05:16:52.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19982025-01-22T05:16:52.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992025-01-22T05:16:52.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20002025-01-22T05:16:52.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20012025-01-22T05:16:52.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.796577ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20022025-01-22T05:16:52.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20032025-01-22T05:16:52.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20042025-01-22T05:16:52.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20052025-01-22T05:16:52.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20062025-01-22T05:16:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20072025-01-22T05:16:52.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20082025-01-22T05:16:52.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
20092025-01-22T05:16:52.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20102025-01-22T05:16:52.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20112025-01-22T05:16:52.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
20122025-01-22T05:16:52.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.895055ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
20132025-01-22T05:16:53.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 15d7e888-86ab-426a-aa41-c67de2095493 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20142025-01-22T05:16:53.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 15d7e888-86ab-426a-aa41-c67de2095493 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20152025-01-22T05:16:53.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 15d7e888-86ab-426a-aa41-c67de2095493 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20162025-01-22T05:16:54.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0087f1ad-87d6-450e-a050-5c720a15e8c6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20172025-01-22T05:16:54.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0087f1ad-87d6-450e-a050-5c720a15e8c6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20182025-01-22T05:16:54.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0087f1ad-87d6-450e-a050-5c720a15e8c6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20192025-01-22T05:16:55.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cc6e13ee-78c5-4aa3-a476-143428527d61 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20202025-01-22T05:16:55.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cc6e13ee-78c5-4aa3-a476-143428527d61 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20212025-01-22T05:16:55.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cc6e13ee-78c5-4aa3-a476-143428527d61 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20222025-01-22T05:16:55.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 460 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 487213c9-87e3-4d05-ba2e-2fd413141ec9 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
20232025-01-22T05:16:56.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8b34ddb2-9944-4f29-9019-5dc7683ed9a9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20242025-01-22T05:16:56.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8b34ddb2-9944-4f29-9019-5dc7683ed9a9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20252025-01-22T05:16:56.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8b34ddb2-9944-4f29-9019-5dc7683ed9a9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20262025-01-22T05:16:57.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f8dd05c-fba5-447b-b804-4f6761afeda1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20272025-01-22T05:16:57.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f8dd05c-fba5-447b-b804-4f6761afeda1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20282025-01-22T05:16:57.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f8dd05c-fba5-447b-b804-4f6761afeda1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20292025-01-22T05:16:58.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4361bd15-9210-4ec4-b21e-15c8d1c2dd0b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20302025-01-22T05:16:58.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4361bd15-9210-4ec4-b21e-15c8d1c2dd0b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20312025-01-22T05:16:58.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4361bd15-9210-4ec4-b21e-15c8d1c2dd0b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20322025-01-22T05:16:59.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 46c94e7d-dd57-4151-87bf-0b7be38b3199 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20332025-01-22T05:16:59.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 46c94e7d-dd57-4151-87bf-0b7be38b3199 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20342025-01-22T05:16:59.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 46c94e7d-dd57-4151-87bf-0b7be38b3199 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20352025-01-22T05:17:00.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 213e3eed-2a9b-4940-a0ba-20fef530359c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20362025-01-22T05:17:00.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 213e3eed-2a9b-4940-a0ba-20fef530359c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20372025-01-22T05:17:00.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 213e3eed-2a9b-4940-a0ba-20fef530359c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20382025-01-22T05:17:01.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cfa37f87-230f-41d3-9fb2-a7ebf0988401 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20392025-01-22T05:17:01.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cfa37f87-230f-41d3-9fb2-a7ebf0988401 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20402025-01-22T05:17:01.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cfa37f87-230f-41d3-9fb2-a7ebf0988401 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20412025-01-22T05:17:02.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fbfcaf4b-d445-47f3-909a-85af8935fa49 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20422025-01-22T05:17:02.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fbfcaf4b-d445-47f3-909a-85af8935fa49 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20432025-01-22T05:17:02.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fbfcaf4b-d445-47f3-909a-85af8935fa49 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
20442025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
20452025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
20462025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20472025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
20482025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
20492025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
20502025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20512025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20522025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
20532025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20542025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20552025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
20562025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20572025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
20582025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20592025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
20602025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
20612025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20622025-01-22T05:17:02.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20632025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20642025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20652025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20662025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20672025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20682025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20692025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20702025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20712025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20722025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
20732025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20742025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
20752025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20762025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20772025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
20782025-01-22T05:17:02.822ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20792025-01-22T05:17:02.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20802025-01-22T05:17:02.823ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
20812025-01-22T05:17:02.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20822025-01-22T05:17:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20832025-01-22T05:17:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20842025-01-22T05:17:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20852025-01-22T05:17:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20862025-01-22T05:17:02.824ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.139534ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20872025-01-22T05:17:02.825ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11205, tv_nsec: 174299945 } })
20882025-01-22T05:17:02.825ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
20892025-01-22T05:17:02.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11205, tv_nsec: 175241605 } })
20902025-01-22T05:17:02.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20912025-01-22T05:17:02.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
20922025-01-22T05:17:02.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20932025-01-22T05:17:02.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20942025-01-22T05:17:02.827ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20952025-01-22T05:17:02.827ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20962025-01-22T05:17:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20972025-01-22T05:17:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20982025-01-22T05:17:02.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20992025-01-22T05:17:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21002025-01-22T05:17:02.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21012025-01-22T05:17:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21022025-01-22T05:17:02.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21032025-01-22T05:17:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21042025-01-22T05:17:02.830ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21052025-01-22T05:17:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21062025-01-22T05:17:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21072025-01-22T05:17:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21082025-01-22T05:17:02.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21092025-01-22T05:17:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21102025-01-22T05:17:02.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21112025-01-22T05:17:02.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21122025-01-22T05:17:02.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21132025-01-22T05:17:02.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21142025-01-22T05:17:02.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21152025-01-22T05:17:02.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21162025-01-22T05:17:02.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21172025-01-22T05:17:02.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 12.560056ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21182025-01-22T05:17:02.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21192025-01-22T05:17:02.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21202025-01-22T05:17:02.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21212025-01-22T05:17:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21222025-01-22T05:17:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21232025-01-22T05:17:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21242025-01-22T05:17:02.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21252025-01-22T05:17:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21262025-01-22T05:17:02.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21272025-01-22T05:17:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21282025-01-22T05:17:02.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21292025-01-22T05:17:02.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21302025-01-22T05:17:02.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21312025-01-22T05:17:02.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.354043ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21322025-01-22T05:17:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21332025-01-22T05:17:02.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21342025-01-22T05:17:02.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21352025-01-22T05:17:02.839ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11205, tv_nsec: 188377162 } })
21362025-01-22T05:17:02.839ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
21372025-01-22T05:17:02.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21382025-01-22T05:17:02.840ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21392025-01-22T05:17:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21402025-01-22T05:17:02.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21412025-01-22T05:17:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21422025-01-22T05:17:02.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21432025-01-22T05:17:02.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21442025-01-22T05:17:02.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21452025-01-22T05:17:02.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21462025-01-22T05:17:02.842ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21472025-01-22T05:17:02.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21482025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
21492025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
21502025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21512025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21522025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
21532025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21542025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
21552025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
21562025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21572025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
21582025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21592025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21602025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21612025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21622025-01-22T05:17:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21632025-01-22T05:17:02.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
21642025-01-22T05:17:02.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.7852ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
21652025-01-22T05:17:02.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21662025-01-22T05:17:02.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21672025-01-22T05:17:02.865ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21682025-01-22T05:17:02.865ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21692025-01-22T05:17:02.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21702025-01-22T05:17:02.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21712025-01-22T05:17:02.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21722025-01-22T05:17:02.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21732025-01-22T05:17:02.868ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21742025-01-22T05:17:02.868ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21752025-01-22T05:17:02.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21762025-01-22T05:17:02.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21772025-01-22T05:17:02.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21782025-01-22T05:17:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
21792025-01-22T05:17:02.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21802025-01-22T05:17:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21812025-01-22T05:17:02.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21822025-01-22T05:17:02.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21832025-01-22T05:17:02.879ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 57.214995ms iteration = 14 status = 0
21842025-01-22T05:17:02.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21852025-01-22T05:17:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21862025-01-22T05:17:02.884ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21872025-01-22T05:17:02.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21882025-01-22T05:17:02.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.433094ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
21892025-01-22T05:17:02.891ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21902025-01-22T05:17:02.891ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.330872ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21912025-01-22T05:17:02.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21922025-01-22T05:17:02.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.193192ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
21932025-01-22T05:17:02.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21942025-01-22T05:17:02.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 51.175203ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21952025-01-22T05:17:02.896ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
21962025-01-22T05:17:02.896ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21972025-01-22T05:17:02.896ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaf30022-a2cd-4bff-9fe6-db005904dd94", "content-length": "26", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
21982025-01-22T05:17:02.896ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21992025-01-22T05:17:02.898ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22002025-01-22T05:17:02.898ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
22012025-01-22T05:17:02.898ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 76.586581ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
22022025-01-22T05:17:02.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
22032025-01-22T05:17:02.912ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22042025-01-22T05:17:02.912ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ead688b1-42f0-406f-a947-68e74773d735", "content-length": "26", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
22052025-01-22T05:17:02.912ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22062025-01-22T05:17:02.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22072025-01-22T05:17:02.915ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22082025-01-22T05:17:02.915ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22092025-01-22T05:17:02.915ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.852662ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22102025-01-22T05:17:02.919ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
22112025-01-22T05:17:02.919ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22122025-01-22T05:17:02.919ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "00fc3624-10d2-4a34-a6c1-02056f190516", "content-length": "26", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
22132025-01-22T05:17:02.919ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22142025-01-22T05:17:02.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 75.719243ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
22152025-01-22T05:17:02.920ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
22162025-01-22T05:17:02.953ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.621022ms iteration = 16 status = {"physical_disks_added":0}
22172025-01-22T05:17:02.981ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22182025-01-22T05:17:02.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22192025-01-22T05:17:02.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22202025-01-22T05:17:02.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22212025-01-22T05:17:02.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22222025-01-22T05:17:02.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22232025-01-22T05:17:02.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22242025-01-22T05:17:02.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22252025-01-22T05:17:02.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22262025-01-22T05:17:02.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22272025-01-22T05:17:02.998ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 176.433084ms iteration = 14 status = {}
22282025-01-22T05:17:03.020ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22292025-01-22T05:17:03.020ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e822293-8421-471f-bcb2-46b93401bc19", "content-length": "1", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
22302025-01-22T05:17:03.021ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22312025-01-22T05:17:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22322025-01-22T05:17:03.024ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.393693ms iteration = 14 status = null
22332025-01-22T05:17:03.120ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22342025-01-22T05:17:03.120ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22352025-01-22T05:17:03.126ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22362025-01-22T05:17:03.169ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fa43b6e-4721-44ae-8353-a163f401a715", "content-length": "691", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
22372025-01-22T05:17:03.169ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
22382025-01-22T05:17:03.169ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
22392025-01-22T05:17:03.169ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
22402025-01-22T05:17:03.169ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7681a645-588f-447b-8726-841b4e5f26e0", "content-length": "372", "date": "Wed, 22 Jan 2025 05:17:03 GMT"} })
22412025-01-22T05:17:03.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22422025-01-22T05:17:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22432025-01-22T05:17:03.171ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 349.777795ms iteration = 14 status = {}
22442025-01-22T05:17:03.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22452025-01-22T05:17:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22462025-01-22T05:17:03.180ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
22472025-01-22T05:17:03.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22482025-01-22T05:17:03.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22492025-01-22T05:17:03.190ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22502025-01-22T05:17:03.190ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9287d2e-84c6-4928-8b5d-f5aca321f34a", "content-length": "134", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
22512025-01-22T05:17:03.190ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22522025-01-22T05:17:03.190ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
22532025-01-22T05:17:03.190ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22542025-01-22T05:17:03.190ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22552025-01-22T05:17:03.190ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22562025-01-22T05:17:03.190ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22572025-01-22T05:17:03.190ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22582025-01-22T05:17:03.190ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22592025-01-22T05:17:03.190ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22602025-01-22T05:17:03.191ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22612025-01-22T05:17:03.191ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
22622025-01-22T05:17:03.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22632025-01-22T05:17:03.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22642025-01-22T05:17:03.193ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22652025-01-22T05:17:03.193ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ee1b59a-7b8b-4ffd-895a-a68d3bba4f5d", "content-length": "2", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
22662025-01-22T05:17:03.193ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22672025-01-22T05:17:03.193ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8de98fd6-6c69-438c-82bc-3a8b4de4f2c7", "content-length": "51", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
22682025-01-22T05:17:03.193ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
22692025-01-22T05:17:03.193ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22702025-01-22T05:17:03.217ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
22712025-01-22T05:17:03.217ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22722025-01-22T05:17:03.287ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "351dae3a-d8a3-4b61-9e7f-83374ee425bf", "date": "Wed, 22 Jan 2025 05:17:03 GMT"} })
22732025-01-22T05:17:03.287ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
22742025-01-22T05:17:03.287ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22752025-01-22T05:17:03.287ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9fbbd9e4-e4c0-4872-82b1-babcafa7bd9b", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
22762025-01-22T05:17:03.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22772025-01-22T05:17:03.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22782025-01-22T05:17:03.288ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "53365eb5-ed57-4e22-856c-29b75233d466", "content-length": "682", "date": "Wed, 22 Jan 2025 05:17:02 GMT"} })
22792025-01-22T05:17:03.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22802025-01-22T05:17:03.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22812025-01-22T05:17:03.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22822025-01-22T05:17:03.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22832025-01-22T05:17:03.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22842025-01-22T05:17:03.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22852025-01-22T05:17:03.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22862025-01-22T05:17:03.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22872025-01-22T05:17:03.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22882025-01-22T05:17:03.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22892025-01-22T05:17:03.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22902025-01-22T05:17:03.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22912025-01-22T05:17:03.297ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22922025-01-22T05:17:03.297ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22932025-01-22T05:17:03.298ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fc0485fe-b8ed-41b3-ac13-f99fda3d23ca", "date": "Wed, 22 Jan 2025 05:17:03 GMT"} })
22942025-01-22T05:17:03.299ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 476.428985ms iteration = 14 status = {}
22952025-01-22T05:17:03.302ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 480.994239ms iteration = 14 status = {}
22962025-01-22T05:17:03.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d2e937b1-e229-4b87-baa1-9aacd864fcf5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
22972025-01-22T05:17:03.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d2e937b1-e229-4b87-baa1-9aacd864fcf5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
22982025-01-22T05:17:03.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d2e937b1-e229-4b87-baa1-9aacd864fcf5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
22992025-01-22T05:17:04.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 04d08fc5-fc4c-4c62-beb1-396dac4b7f56 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23002025-01-22T05:17:04.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 04d08fc5-fc4c-4c62-beb1-396dac4b7f56 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23012025-01-22T05:17:04.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 04d08fc5-fc4c-4c62-beb1-396dac4b7f56 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23022025-01-22T05:17:04.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = f3aea761-b207-4f1e-8ca3-1f9c00a09fdd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23032025-01-22T05:17:04.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = f3aea761-b207-4f1e-8ca3-1f9c00a09fdd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23042025-01-22T05:17:04.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = f3aea761-b207-4f1e-8ca3-1f9c00a09fdd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23052025-01-22T05:17:05.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8977e834-3109-4e0c-bf43-c9babb814063 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23062025-01-22T05:17:05.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8977e834-3109-4e0c-bf43-c9babb814063 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23072025-01-22T05:17:05.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8977e834-3109-4e0c-bf43-c9babb814063 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23082025-01-22T05:17:05.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 780 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 28864a78-2ccb-4ce9-8ab8-7b133af9d0ff response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
23092025-01-22T05:17:06.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d000187d-9c47-4194-8146-2ff2cd8db503 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23102025-01-22T05:17:06.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d000187d-9c47-4194-8146-2ff2cd8db503 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23112025-01-22T05:17:06.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d000187d-9c47-4194-8146-2ff2cd8db503 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23122025-01-22T05:17:07.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 475ddea6-9be1-489c-9dbf-5323978158b1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23132025-01-22T05:17:07.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 475ddea6-9be1-489c-9dbf-5323978158b1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23142025-01-22T05:17:07.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 475ddea6-9be1-489c-9dbf-5323978158b1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23152025-01-22T05:17:08.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0717b871-7ee4-4ad4-93cc-b6c2027365de roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23162025-01-22T05:17:08.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0717b871-7ee4-4ad4-93cc-b6c2027365de resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23172025-01-22T05:17:08.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0717b871-7ee4-4ad4-93cc-b6c2027365de response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23182025-01-22T05:17:09.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f54a986d-6a86-41ed-9959-05045fa3e391 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23192025-01-22T05:17:09.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f54a986d-6a86-41ed-9959-05045fa3e391 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23202025-01-22T05:17:09.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f54a986d-6a86-41ed-9959-05045fa3e391 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23212025-01-22T05:17:10.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dd1f47e3-ef17-4a4a-b534-22605280ab70 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23222025-01-22T05:17:10.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dd1f47e3-ef17-4a4a-b534-22605280ab70 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23232025-01-22T05:17:10.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dd1f47e3-ef17-4a4a-b534-22605280ab70 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23242025-01-22T05:17:11.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e159a502-ffaf-4a04-b291-07ebca938084 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23252025-01-22T05:17:11.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e159a502-ffaf-4a04-b291-07ebca938084 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23262025-01-22T05:17:11.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e159a502-ffaf-4a04-b291-07ebca938084 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23272025-01-22T05:17:12.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8f20bdb8-016b-446d-a491-9338ac9c61e4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23282025-01-22T05:17:12.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8f20bdb8-016b-446d-a491-9338ac9c61e4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23292025-01-22T05:17:12.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8f20bdb8-016b-446d-a491-9338ac9c61e4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23302025-01-22T05:17:12.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
23312025-01-22T05:17:12.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23322025-01-22T05:17:12.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23332025-01-22T05:17:12.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
23342025-01-22T05:17:12.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23352025-01-22T05:17:12.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23362025-01-22T05:17:12.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23372025-01-22T05:17:12.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23382025-01-22T05:17:12.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23392025-01-22T05:17:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23402025-01-22T05:17:12.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23412025-01-22T05:17:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23422025-01-22T05:17:12.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.181826ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23432025-01-22T05:17:12.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23442025-01-22T05:17:12.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23452025-01-22T05:17:12.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23462025-01-22T05:17:12.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
23472025-01-22T05:17:12.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23482025-01-22T05:17:12.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23492025-01-22T05:17:12.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
23502025-01-22T05:17:12.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.165671ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
23512025-01-22T05:17:13.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dae35af8-c038-4918-8826-4e38133b1518 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23522025-01-22T05:17:13.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dae35af8-c038-4918-8826-4e38133b1518 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23532025-01-22T05:17:13.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dae35af8-c038-4918-8826-4e38133b1518 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23542025-01-22T05:17:14.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1fa9e9f-bea4-4078-ac1a-4f8517016a4e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23552025-01-22T05:17:14.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1fa9e9f-bea4-4078-ac1a-4f8517016a4e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23562025-01-22T05:17:14.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1fa9e9f-bea4-4078-ac1a-4f8517016a4e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23572025-01-22T05:17:15.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c35500a2-c6ae-499c-b144-01083713a93e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23582025-01-22T05:17:15.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c35500a2-c6ae-499c-b144-01083713a93e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23592025-01-22T05:17:15.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c35500a2-c6ae-499c-b144-01083713a93e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23602025-01-22T05:17:15.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 162a46ce-4b66-4120-957d-eea9f254c815 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
23612025-01-22T05:17:15.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 162a46ce-4b66-4120-957d-eea9f254c815 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
23622025-01-22T05:17:15.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 162a46ce-4b66-4120-957d-eea9f254c815 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
23632025-01-22T05:17:15.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 89d63f43-417f-4565-aa96-e4ae2fd92e22 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
23642025-01-22T05:17:15.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 89d63f43-417f-4565-aa96-e4ae2fd92e22 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
23652025-01-22T05:17:15.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 89d63f43-417f-4565-aa96-e4ae2fd92e22 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
23662025-01-22T05:17:15.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 424 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = cc728a64-6ea0-423e-8fcb-a5b40b8b6139 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
23672025-01-22T05:17:16.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = af8d702f-3edf-4f36-83ca-165facb7159e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23682025-01-22T05:17:16.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = af8d702f-3edf-4f36-83ca-165facb7159e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23692025-01-22T05:17:16.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = af8d702f-3edf-4f36-83ca-165facb7159e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23702025-01-22T05:17:17.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 99baa9fe-da1e-4a68-9ac6-c4e3cead9460 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23712025-01-22T05:17:17.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 99baa9fe-da1e-4a68-9ac6-c4e3cead9460 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23722025-01-22T05:17:17.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 99baa9fe-da1e-4a68-9ac6-c4e3cead9460 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23732025-01-22T05:17:18.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 278eac4e-3168-4b4d-9a29-8aaddf9e8fef roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23742025-01-22T05:17:18.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 278eac4e-3168-4b4d-9a29-8aaddf9e8fef resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23752025-01-22T05:17:18.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 278eac4e-3168-4b4d-9a29-8aaddf9e8fef response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23762025-01-22T05:17:19.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 46413fc5-c07e-4ff1-90ee-6aca06015b03 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23772025-01-22T05:17:19.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 46413fc5-c07e-4ff1-90ee-6aca06015b03 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23782025-01-22T05:17:19.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 46413fc5-c07e-4ff1-90ee-6aca06015b03 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23792025-01-22T05:17:20.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9eebd945-993d-4b67-bc66-f7cc6e5116b7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23802025-01-22T05:17:20.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9eebd945-993d-4b67-bc66-f7cc6e5116b7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23812025-01-22T05:17:20.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9eebd945-993d-4b67-bc66-f7cc6e5116b7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23822025-01-22T05:17:21.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6308577c-56a9-47ea-9045-526860db7437 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23832025-01-22T05:17:21.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6308577c-56a9-47ea-9045-526860db7437 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23842025-01-22T05:17:21.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6308577c-56a9-47ea-9045-526860db7437 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23852025-01-22T05:17:22.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 91499c62-7f90-499d-b8aa-fdcd5fcddb6a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23862025-01-22T05:17:22.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 91499c62-7f90-499d-b8aa-fdcd5fcddb6a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23872025-01-22T05:17:22.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 91499c62-7f90-499d-b8aa-fdcd5fcddb6a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
23882025-01-22T05:17:22.821ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
23892025-01-22T05:17:22.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23902025-01-22T05:17:22.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23912025-01-22T05:17:22.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
23922025-01-22T05:17:22.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23932025-01-22T05:17:22.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23942025-01-22T05:17:22.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23952025-01-22T05:17:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23962025-01-22T05:17:22.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23972025-01-22T05:17:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23982025-01-22T05:17:22.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23992025-01-22T05:17:22.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24002025-01-22T05:17:22.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24012025-01-22T05:17:22.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
24022025-01-22T05:17:22.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24032025-01-22T05:17:22.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24042025-01-22T05:17:22.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
24052025-01-22T05:17:22.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.925276ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
24062025-01-22T05:17:22.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24072025-01-22T05:17:22.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24082025-01-22T05:17:22.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.763037ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24092025-01-22T05:17:23.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 02ef087f-e240-47e2-9c36-fc86b46c8553 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24102025-01-22T05:17:23.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 02ef087f-e240-47e2-9c36-fc86b46c8553 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24112025-01-22T05:17:23.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 02ef087f-e240-47e2-9c36-fc86b46c8553 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24122025-01-22T05:17:24.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 384ab2aa-2239-41f2-8a25-608ca40b84c0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24132025-01-22T05:17:24.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 384ab2aa-2239-41f2-8a25-608ca40b84c0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24142025-01-22T05:17:24.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 384ab2aa-2239-41f2-8a25-608ca40b84c0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24152025-01-22T05:17:25.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a697bc1b-e743-462c-b378-f9570cd416b3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24162025-01-22T05:17:25.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a697bc1b-e743-462c-b378-f9570cd416b3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24172025-01-22T05:17:25.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a697bc1b-e743-462c-b378-f9570cd416b3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24182025-01-22T05:17:25.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 8d47c84c-ee42-43d0-9c3b-731667d6ed3d response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
24192025-01-22T05:17:26.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb4e3abc-4c3d-4eae-99f2-9e9ecda560b5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24202025-01-22T05:17:26.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb4e3abc-4c3d-4eae-99f2-9e9ecda560b5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24212025-01-22T05:17:26.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb4e3abc-4c3d-4eae-99f2-9e9ecda560b5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24222025-01-22T05:17:27.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bebcac34-2a71-4999-a5d9-97c408a7f497 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24232025-01-22T05:17:27.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bebcac34-2a71-4999-a5d9-97c408a7f497 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24242025-01-22T05:17:27.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bebcac34-2a71-4999-a5d9-97c408a7f497 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24252025-01-22T05:17:28.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0f30c1b2-8a9d-487a-9140-2b3459a7216a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24262025-01-22T05:17:28.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0f30c1b2-8a9d-487a-9140-2b3459a7216a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24272025-01-22T05:17:28.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0f30c1b2-8a9d-487a-9140-2b3459a7216a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24282025-01-22T05:17:29.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d756ba2f-f677-4c9c-a4e4-0ab9be815741 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24292025-01-22T05:17:29.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d756ba2f-f677-4c9c-a4e4-0ab9be815741 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24302025-01-22T05:17:29.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d756ba2f-f677-4c9c-a4e4-0ab9be815741 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24312025-01-22T05:17:30.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1119b20b-a09a-4ad1-bcc0-774d119e3600 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24322025-01-22T05:17:30.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1119b20b-a09a-4ad1-bcc0-774d119e3600 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24332025-01-22T05:17:30.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1119b20b-a09a-4ad1-bcc0-774d119e3600 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24342025-01-22T05:17:30.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 4b96691a-0940-4c34-bd19-8100a66fa818 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
24352025-01-22T05:17:30.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 4b96691a-0940-4c34-bd19-8100a66fa818 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
24362025-01-22T05:17:30.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 4b96691a-0940-4c34-bd19-8100a66fa818 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
24372025-01-22T05:17:30.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = b5dff81d-3f55-4a32-b6a9-65fed1d78b4c roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
24382025-01-22T05:17:30.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = b5dff81d-3f55-4a32-b6a9-65fed1d78b4c resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
24392025-01-22T05:17:30.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = b5dff81d-3f55-4a32-b6a9-65fed1d78b4c response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
24402025-01-22T05:17:31.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f73ab25e-4b30-4683-8b40-e82ecbbbf299 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24412025-01-22T05:17:31.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f73ab25e-4b30-4683-8b40-e82ecbbbf299 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24422025-01-22T05:17:31.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f73ab25e-4b30-4683-8b40-e82ecbbbf299 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
24432025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
24442025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
24452025-01-22T05:17:32.822ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
24462025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
24472025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24482025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
24492025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24502025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
24512025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
24522025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24532025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
24542025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24552025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
24562025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24572025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
24582025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24592025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
24602025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
24612025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24622025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
24632025-01-22T05:17:32.822ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:07:32.822614956 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
24642025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
24652025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
24662025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24672025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
24682025-01-22T05:17:32.822ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
24692025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.361\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
24702025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
24712025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
24722025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
24732025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
24742025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24752025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24762025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24772025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24782025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
24792025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
24802025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
24812025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24822025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
24832025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
24842025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24852025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
24862025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24872025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
24882025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24892025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24902025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
24912025-01-22T05:17:32.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24922025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
24932025-01-22T05:17:32.823ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24942025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24952025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
24962025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24972025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24982025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24992025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25002025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25012025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25022025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25032025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25042025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25052025-01-22T05:17:32.823ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11235, tv_nsec: 172182772 } })
25062025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25072025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
25082025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25092025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25102025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25112025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25122025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25132025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25142025-01-22T05:17:32.823ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11235, tv_nsec: 172322505 } })
25152025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
25162025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25172025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25182025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25192025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
25202025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.150344ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
25212025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
25222025-01-22T05:17:32.823ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.170354ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
25232025-01-22T05:17:32.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25242025-01-22T05:17:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25252025-01-22T05:17:32.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25262025-01-22T05:17:32.825ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25272025-01-22T05:17:32.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25282025-01-22T05:17:32.826ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.999271ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25292025-01-22T05:17:32.827ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11235, tv_nsec: 176309986 } })
25302025-01-22T05:17:32.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
25312025-01-22T05:17:32.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25322025-01-22T05:17:32.827ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25332025-01-22T05:17:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25342025-01-22T05:17:32.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25352025-01-22T05:17:32.828ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25362025-01-22T05:17:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25372025-01-22T05:17:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25382025-01-22T05:17:32.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25392025-01-22T05:17:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25402025-01-22T05:17:32.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25412025-01-22T05:17:32.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25422025-01-22T05:17:32.832ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25432025-01-22T05:17:32.833ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:07:32.822614956 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
25442025-01-22T05:17:32.833ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.397002ms iteration = 8 status = {"expiration":"2025-01-22T05:07:32.822614956Z","pruned":[]}
25452025-01-22T05:17:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25462025-01-22T05:17:32.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25472025-01-22T05:17:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25482025-01-22T05:17:32.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25492025-01-22T05:17:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25502025-01-22T05:17:32.834ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25512025-01-22T05:17:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25522025-01-22T05:17:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25532025-01-22T05:17:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25542025-01-22T05:17:32.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25552025-01-22T05:17:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25562025-01-22T05:17:32.836ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25572025-01-22T05:17:32.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25582025-01-22T05:17:32.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25592025-01-22T05:17:32.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25602025-01-22T05:17:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25612025-01-22T05:17:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25622025-01-22T05:17:32.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25632025-01-22T05:17:32.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25642025-01-22T05:17:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25652025-01-22T05:17:32.840ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11235, tv_nsec: 188958114 } })
25662025-01-22T05:17:32.840ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
25672025-01-22T05:17:32.840ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
25682025-01-22T05:17:32.840ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
25692025-01-22T05:17:32.840ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.743881ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
25702025-01-22T05:17:32.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25712025-01-22T05:17:32.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25722025-01-22T05:17:32.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25732025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
25742025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
25752025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
25762025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25772025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
25782025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
25792025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
25802025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25812025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
25822025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25832025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
25842025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
25852025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25862025-01-22T05:17:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25872025-01-22T05:17:32.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25882025-01-22T05:17:32.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25892025-01-22T05:17:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25902025-01-22T05:17:32.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 25.440808ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25912025-01-22T05:17:32.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25922025-01-22T05:17:32.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25932025-01-22T05:17:32.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25942025-01-22T05:17:32.849ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11235, tv_nsec: 198856166 } })
25952025-01-22T05:17:32.850ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
25962025-01-22T05:17:32.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25972025-01-22T05:17:32.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25982025-01-22T05:17:32.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25992025-01-22T05:17:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26002025-01-22T05:17:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26012025-01-22T05:17:32.855ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
26022025-01-22T05:17:32.855ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
26032025-01-22T05:17:32.855ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
26042025-01-22T05:17:32.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26052025-01-22T05:17:32.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26062025-01-22T05:17:32.856ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.599556ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
26072025-01-22T05:17:32.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.7246ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
26082025-01-22T05:17:32.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26092025-01-22T05:17:32.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26102025-01-22T05:17:32.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
26112025-01-22T05:17:32.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26122025-01-22T05:17:32.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26132025-01-22T05:17:32.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26142025-01-22T05:17:32.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26152025-01-22T05:17:32.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26162025-01-22T05:17:32.883ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26172025-01-22T05:17:32.883ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26182025-01-22T05:17:32.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26192025-01-22T05:17:32.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26202025-01-22T05:17:32.892ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26212025-01-22T05:17:32.892ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26222025-01-22T05:17:32.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26232025-01-22T05:17:32.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26242025-01-22T05:17:32.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26252025-01-22T05:17:32.897ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26262025-01-22T05:17:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26272025-01-22T05:17:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26282025-01-22T05:17:32.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26292025-01-22T05:17:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26302025-01-22T05:17:32.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26312025-01-22T05:17:32.899ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26322025-01-22T05:17:32.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26332025-01-22T05:17:32.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26342025-01-22T05:17:32.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26352025-01-22T05:17:32.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26362025-01-22T05:17:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26372025-01-22T05:17:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26382025-01-22T05:17:32.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26392025-01-22T05:17:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26402025-01-22T05:17:32.905ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
26412025-01-22T05:17:32.905ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
26422025-01-22T05:17:32.905ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
26432025-01-22T05:17:32.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26442025-01-22T05:17:32.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26452025-01-22T05:17:32.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26462025-01-22T05:17:32.907ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
26472025-01-22T05:17:32.907ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 84.44822ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
26482025-01-22T05:17:32.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.594133ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26492025-01-22T05:17:32.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26502025-01-22T05:17:32.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26512025-01-22T05:17:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
26522025-01-22T05:17:32.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26532025-01-22T05:17:32.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26542025-01-22T05:17:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26552025-01-22T05:17:32.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26562025-01-22T05:17:32.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26572025-01-22T05:17:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26582025-01-22T05:17:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26592025-01-22T05:17:32.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26602025-01-22T05:17:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26612025-01-22T05:17:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26622025-01-22T05:17:32.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26632025-01-22T05:17:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26642025-01-22T05:17:32.914ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26652025-01-22T05:17:32.915ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26662025-01-22T05:17:32.915ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.912352ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26672025-01-22T05:17:32.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26682025-01-22T05:17:32.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26692025-01-22T05:17:32.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26702025-01-22T05:17:32.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26712025-01-22T05:17:32.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26722025-01-22T05:17:32.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26732025-01-22T05:17:32.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26742025-01-22T05:17:32.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26752025-01-22T05:17:32.924ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26762025-01-22T05:17:32.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
26772025-01-22T05:17:32.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.374405ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
26782025-01-22T05:17:32.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
26792025-01-22T05:17:32.926ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26802025-01-22T05:17:32.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26812025-01-22T05:17:32.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26822025-01-22T05:17:32.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26832025-01-22T05:17:32.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26842025-01-22T05:17:32.929ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
26852025-01-22T05:17:32.929ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
26862025-01-22T05:17:32.929ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 106.549781ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
26872025-01-22T05:17:32.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26882025-01-22T05:17:32.929ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.359276ms iteration = 15 status = 0
26892025-01-22T05:17:32.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26902025-01-22T05:17:32.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26912025-01-22T05:17:32.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26922025-01-22T05:17:32.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26932025-01-22T05:17:32.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26942025-01-22T05:17:32.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 92.2973ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
26952025-01-22T05:17:32.936ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26962025-01-22T05:17:32.938ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26972025-01-22T05:17:32.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26982025-01-22T05:17:32.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26992025-01-22T05:17:32.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
27002025-01-22T05:17:32.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27012025-01-22T05:17:32.948ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27022025-01-22T05:17:32.948ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27032025-01-22T05:17:32.948ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.543427ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27042025-01-22T05:17:32.949ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
27052025-01-22T05:17:32.949ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
27062025-01-22T05:17:32.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27072025-01-22T05:17:32.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27082025-01-22T05:17:32.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27092025-01-22T05:17:32.951ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27102025-01-22T05:17:32.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27112025-01-22T05:17:32.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27122025-01-22T05:17:32.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27132025-01-22T05:17:32.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27142025-01-22T05:17:32.957ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
27152025-01-22T05:17:32.957ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
27162025-01-22T05:17:32.957ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
27172025-01-22T05:17:32.957ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 135.037441ms iteration = 8 status = {"generation":1}
27182025-01-22T05:17:32.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.629389ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27192025-01-22T05:17:32.978ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
27202025-01-22T05:17:32.979ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
27212025-01-22T05:17:32.979ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
27222025-01-22T05:17:32.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27232025-01-22T05:17:32.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27242025-01-22T05:17:32.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27252025-01-22T05:17:32.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.37237ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
27262025-01-22T05:17:32.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27272025-01-22T05:17:32.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27282025-01-22T05:17:32.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27292025-01-22T05:17:32.988ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
27302025-01-22T05:17:32.988ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
27312025-01-22T05:17:32.988ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
27322025-01-22T05:17:32.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 165.869509ms iteration = 8 status = {"generation":2}
27332025-01-22T05:17:32.990ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
27342025-01-22T05:17:32.990ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 167.490622ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
27352025-01-22T05:17:33.009ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
27362025-01-22T05:17:33.009ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27372025-01-22T05:17:33.009ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aecbb066-2db7-41e6-adfc-5645881bcd84", "content-length": "26", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
27382025-01-22T05:17:33.009ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27392025-01-22T05:17:33.011ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
27402025-01-22T05:17:33.021ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
27412025-01-22T05:17:33.021ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27422025-01-22T05:17:33.021ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f016600a-7249-4115-bb3a-4d33c4e1be40", "content-length": "26", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
27432025-01-22T05:17:33.021ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27442025-01-22T05:17:33.023ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27452025-01-22T05:17:33.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 88343f3d-2c85-463c-9d3f-995edf1cebc5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
27462025-01-22T05:17:33.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 88343f3d-2c85-463c-9d3f-995edf1cebc5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
27472025-01-22T05:17:33.041ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 218.513881ms iteration = 17 status = {"physical_disks_added":0}
27482025-01-22T05:17:33.058ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
27492025-01-22T05:17:33.058ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 235.470707ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
27502025-01-22T05:17:33.097ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
27512025-01-22T05:17:33.097ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27522025-01-22T05:17:33.098ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83d9d348-ac89-4d3c-8b6c-0eee04e06c56", "content-length": "26", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
27532025-01-22T05:17:33.098ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27542025-01-22T05:17:33.098ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27552025-01-22T05:17:33.100ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27562025-01-22T05:17:33.165ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27572025-01-22T05:17:33.166ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27582025-01-22T05:17:33.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 88343f3d-2c85-463c-9d3f-995edf1cebc5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
27592025-01-22T05:17:33.169ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
27602025-01-22T05:17:33.169ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "eca2f88a-1772-4303-bec8-e8a862289786", "date": "Wed, 22 Jan 2025 05:17:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27612025-01-22T05:17:33.169ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27622025-01-22T05:17:33.171ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f1980752-67c3-4955-a508-9e2e6006bef7", "date": "Wed, 22 Jan 2025 05:17:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27632025-01-22T05:17:33.171ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27642025-01-22T05:17:33.173ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27652025-01-22T05:17:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 350.321106ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
27662025-01-22T05:17:33.198ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 375.382317ms iteration = 15 status = {}
27672025-01-22T05:17:33.201ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27682025-01-22T05:17:33.225ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b013c44-d6e0-4999-9ddb-8f95e4ca970d", "content-length": "691", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
27692025-01-22T05:17:33.226ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
27702025-01-22T05:17:33.226ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
27712025-01-22T05:17:33.226ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
27722025-01-22T05:17:33.226ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2fcecf2-a3d9-4260-b2ed-031db4b70eb2", "content-length": "372", "date": "Wed, 22 Jan 2025 05:17:32 GMT"} })
27732025-01-22T05:17:33.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27742025-01-22T05:17:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27752025-01-22T05:17:33.228ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 405.381188ms iteration = 15 status = {}
27762025-01-22T05:17:33.233ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27772025-01-22T05:17:33.233ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "691ff61a-61df-4609-ae4a-1cddb2004d3f", "content-length": "1", "date": "Wed, 22 Jan 2025 05:17:32 GMT"} })
27782025-01-22T05:17:33.235ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27792025-01-22T05:17:33.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27802025-01-22T05:17:33.236ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
27812025-01-22T05:17:33.237ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 414.998324ms iteration = 15 status = null
27822025-01-22T05:17:33.272ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
27832025-01-22T05:17:33.272ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27842025-01-22T05:17:33.272ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6d9f03f9-5d80-4588-aab1-f93e4ad3b3e9", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
27852025-01-22T05:17:33.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27862025-01-22T05:17:33.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27872025-01-22T05:17:33.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27882025-01-22T05:17:33.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27892025-01-22T05:17:33.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27902025-01-22T05:17:33.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27912025-01-22T05:17:33.281ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27922025-01-22T05:17:33.281ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27932025-01-22T05:17:33.282ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "547a63e3-1d27-479b-91b7-02a2e0a6d781", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
27942025-01-22T05:17:33.284ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 461.294117ms iteration = 15 status = {}
27952025-01-22T05:17:33.301ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
27962025-01-22T05:17:33.301ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "32540acf-0f58-4601-ad7e-3dba6162a1ae", "date": "Wed, 22 Jan 2025 05:17:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27972025-01-22T05:17:33.301ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27982025-01-22T05:17:33.303ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8e040b77-89d5-4669-8218-a8cd53d91749", "date": "Wed, 22 Jan 2025 05:17:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27992025-01-22T05:17:33.303ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28002025-01-22T05:17:33.305ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1d4ec8d1-cc15-4e8b-9536-ea578cb65025", "date": "Wed, 22 Jan 2025 05:17:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28012025-01-22T05:17:33.305ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28022025-01-22T05:17:33.306ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28032025-01-22T05:17:33.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 484.225224ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
28042025-01-22T05:17:33.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28052025-01-22T05:17:33.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28062025-01-22T05:17:33.317ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
28072025-01-22T05:17:33.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28082025-01-22T05:17:33.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28092025-01-22T05:17:33.326ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28102025-01-22T05:17:33.326ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "73df6932-1075-4bf9-aa86-8b4110e598a6", "content-length": "134", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
28112025-01-22T05:17:33.326ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28122025-01-22T05:17:33.326ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
28132025-01-22T05:17:33.327ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28142025-01-22T05:17:33.327ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28152025-01-22T05:17:33.327ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28162025-01-22T05:17:33.327ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28172025-01-22T05:17:33.327ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28182025-01-22T05:17:33.327ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28192025-01-22T05:17:33.327ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28202025-01-22T05:17:33.327ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28212025-01-22T05:17:33.327ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
28222025-01-22T05:17:33.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28232025-01-22T05:17:33.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28242025-01-22T05:17:33.329ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28252025-01-22T05:17:33.329ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1984cdaf-aefb-4b9e-8543-1aeba4028fe6", "content-length": "2", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
28262025-01-22T05:17:33.329ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28272025-01-22T05:17:33.329ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "725b03a1-ac31-42a2-97bf-f5c52a46a5f8", "content-length": "51", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
28282025-01-22T05:17:33.329ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
28292025-01-22T05:17:33.329ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28302025-01-22T05:17:33.423ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "10008044-da86-4ee6-bfdd-9206708475e8", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
28312025-01-22T05:17:33.423ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
28322025-01-22T05:17:33.423ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28332025-01-22T05:17:33.424ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c995451-413a-453c-8498-f9bb61a90ab0", "content-length": "682", "date": "Wed, 22 Jan 2025 05:17:33 GMT"} })
28342025-01-22T05:17:33.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28352025-01-22T05:17:33.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28362025-01-22T05:17:33.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28372025-01-22T05:17:33.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28382025-01-22T05:17:33.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28392025-01-22T05:17:33.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28402025-01-22T05:17:33.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28412025-01-22T05:17:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28422025-01-22T05:17:33.441ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 618.55728ms iteration = 15 status = {}
28432025-01-22T05:17:34.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = df0c70e2-5b69-4ddc-ae58-68fccf3e28f0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28442025-01-22T05:17:34.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = df0c70e2-5b69-4ddc-ae58-68fccf3e28f0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28452025-01-22T05:17:34.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = df0c70e2-5b69-4ddc-ae58-68fccf3e28f0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28462025-01-22T05:17:34.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 1acffc07-cc9f-4c1d-b42f-9fa98fae4414 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
28472025-01-22T05:17:34.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 1acffc07-cc9f-4c1d-b42f-9fa98fae4414 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
28482025-01-22T05:17:34.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 1acffc07-cc9f-4c1d-b42f-9fa98fae4414 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
28492025-01-22T05:17:35.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4195a611-7625-44b1-9a79-e3d7957b4792 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28502025-01-22T05:17:35.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4195a611-7625-44b1-9a79-e3d7957b4792 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28512025-01-22T05:17:35.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4195a611-7625-44b1-9a79-e3d7957b4792 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28522025-01-22T05:17:35.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 11563e88-f62a-41c3-8bff-6cebd7b72754 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
28532025-01-22T05:17:36.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d129cf6b-a330-42f8-8fc6-2184aa8ed1b6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28542025-01-22T05:17:36.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d129cf6b-a330-42f8-8fc6-2184aa8ed1b6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28552025-01-22T05:17:36.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d129cf6b-a330-42f8-8fc6-2184aa8ed1b6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28562025-01-22T05:17:37.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f26ccdf7-5eaf-429b-a467-14cf2c569b14 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28572025-01-22T05:17:37.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f26ccdf7-5eaf-429b-a467-14cf2c569b14 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28582025-01-22T05:17:37.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f26ccdf7-5eaf-429b-a467-14cf2c569b14 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28592025-01-22T05:17:38.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 02ba2653-7cc7-433b-979a-1d4af147fb5c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28602025-01-22T05:17:38.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 02ba2653-7cc7-433b-979a-1d4af147fb5c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28612025-01-22T05:17:38.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 02ba2653-7cc7-433b-979a-1d4af147fb5c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28622025-01-22T05:17:39.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5b685219-b5c0-4013-a73b-ad012ab79f28 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28632025-01-22T05:17:39.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5b685219-b5c0-4013-a73b-ad012ab79f28 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28642025-01-22T05:17:39.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5b685219-b5c0-4013-a73b-ad012ab79f28 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28652025-01-22T05:17:40.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8a92dfd1-33b0-449d-8ccf-a5771a2ecbc2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28662025-01-22T05:17:40.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8a92dfd1-33b0-449d-8ccf-a5771a2ecbc2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28672025-01-22T05:17:40.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8a92dfd1-33b0-449d-8ccf-a5771a2ecbc2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28682025-01-22T05:17:41.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1d8ccaf-9e94-45d8-a5c0-d244b85089ed roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28692025-01-22T05:17:41.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1d8ccaf-9e94-45d8-a5c0-d244b85089ed resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28702025-01-22T05:17:41.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1d8ccaf-9e94-45d8-a5c0-d244b85089ed response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28712025-01-22T05:17:42.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba128ca2-9630-490a-a4d0-c227ca4b11d9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28722025-01-22T05:17:42.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba128ca2-9630-490a-a4d0-c227ca4b11d9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28732025-01-22T05:17:42.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba128ca2-9630-490a-a4d0-c227ca4b11d9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28742025-01-22T05:17:42.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
28752025-01-22T05:17:42.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28762025-01-22T05:17:42.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28772025-01-22T05:17:42.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
28782025-01-22T05:17:42.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28792025-01-22T05:17:42.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28802025-01-22T05:17:42.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28812025-01-22T05:17:42.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28822025-01-22T05:17:42.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28832025-01-22T05:17:42.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28842025-01-22T05:17:42.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28852025-01-22T05:17:42.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28862025-01-22T05:17:42.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28872025-01-22T05:17:42.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
28882025-01-22T05:17:42.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28892025-01-22T05:17:42.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28902025-01-22T05:17:42.847ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
28912025-01-22T05:17:42.847ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.161452ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
28922025-01-22T05:17:42.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28932025-01-22T05:17:42.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28942025-01-22T05:17:42.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.434325ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28952025-01-22T05:17:43.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 43dfdfa9-f8b7-42e1-a1ce-bbc83558100d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28962025-01-22T05:17:43.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 43dfdfa9-f8b7-42e1-a1ce-bbc83558100d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28972025-01-22T05:17:43.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 43dfdfa9-f8b7-42e1-a1ce-bbc83558100d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28982025-01-22T05:17:44.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c0834007-2968-4300-96ae-72bf63b7ef88 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
28992025-01-22T05:17:44.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c0834007-2968-4300-96ae-72bf63b7ef88 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29002025-01-22T05:17:44.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c0834007-2968-4300-96ae-72bf63b7ef88 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29012025-01-22T05:17:45.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b2ffd756-3dfb-43d1-903b-c03149ab8544 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29022025-01-22T05:17:45.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b2ffd756-3dfb-43d1-903b-c03149ab8544 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29032025-01-22T05:17:45.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b2ffd756-3dfb-43d1-903b-c03149ab8544 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29042025-01-22T05:17:45.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 15dc8400-258b-4362-84a2-e657fa21b55f roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
29052025-01-22T05:17:45.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 15dc8400-258b-4362-84a2-e657fa21b55f resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
29062025-01-22T05:17:45.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 15dc8400-258b-4362-84a2-e657fa21b55f response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
29072025-01-22T05:17:45.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 4cf6c3e0-33ca-4951-9adc-8f197632eea1 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
29082025-01-22T05:17:45.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 4cf6c3e0-33ca-4951-9adc-8f197632eea1 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
29092025-01-22T05:17:45.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 4cf6c3e0-33ca-4951-9adc-8f197632eea1 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
29102025-01-22T05:17:45.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 436 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 53785825-ea4e-4661-ad63-402f44028ffd response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
29112025-01-22T05:17:46.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 969dffa3-3390-4efc-89ec-677e9d53dfb8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29122025-01-22T05:17:46.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 969dffa3-3390-4efc-89ec-677e9d53dfb8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29132025-01-22T05:17:46.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 969dffa3-3390-4efc-89ec-677e9d53dfb8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29142025-01-22T05:17:47.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 77d8b81d-d5e8-47fe-9d2b-7d44937be847 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29152025-01-22T05:17:47.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 77d8b81d-d5e8-47fe-9d2b-7d44937be847 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29162025-01-22T05:17:47.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 77d8b81d-d5e8-47fe-9d2b-7d44937be847 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29172025-01-22T05:17:48.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1dbc51d3-16da-4c6a-a848-1d9dab5dcb8f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29182025-01-22T05:17:48.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1dbc51d3-16da-4c6a-a848-1d9dab5dcb8f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29192025-01-22T05:17:48.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1dbc51d3-16da-4c6a-a848-1d9dab5dcb8f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29202025-01-22T05:17:49.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 411a838a-c902-4778-aeb5-263d2398458b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29212025-01-22T05:17:49.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 411a838a-c902-4778-aeb5-263d2398458b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29222025-01-22T05:17:49.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 411a838a-c902-4778-aeb5-263d2398458b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29232025-01-22T05:17:50.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2cb57885-57f4-4cff-a8eb-2bef213f3eb2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29242025-01-22T05:17:50.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2cb57885-57f4-4cff-a8eb-2bef213f3eb2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29252025-01-22T05:17:50.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2cb57885-57f4-4cff-a8eb-2bef213f3eb2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29262025-01-22T05:17:51.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 27195221-7281-40dd-8ae3-8fa7ee068609 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29272025-01-22T05:17:51.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 27195221-7281-40dd-8ae3-8fa7ee068609 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29282025-01-22T05:17:51.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 27195221-7281-40dd-8ae3-8fa7ee068609 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29292025-01-22T05:17:52.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e78efd01-de0a-4b87-8fab-35818d231614 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29302025-01-22T05:17:52.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e78efd01-de0a-4b87-8fab-35818d231614 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29312025-01-22T05:17:52.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e78efd01-de0a-4b87-8fab-35818d231614 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29322025-01-22T05:17:52.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
29332025-01-22T05:17:52.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29342025-01-22T05:17:52.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29352025-01-22T05:17:52.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
29362025-01-22T05:17:52.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29372025-01-22T05:17:52.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29382025-01-22T05:17:52.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29392025-01-22T05:17:52.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29402025-01-22T05:17:52.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29412025-01-22T05:17:52.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29422025-01-22T05:17:52.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29432025-01-22T05:17:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29442025-01-22T05:17:52.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29452025-01-22T05:17:52.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29462025-01-22T05:17:52.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472025-01-22T05:17:52.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
29482025-01-22T05:17:52.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29492025-01-22T05:17:52.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29502025-01-22T05:17:52.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
29512025-01-22T05:17:52.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.10654ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
29522025-01-22T05:17:52.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.054372ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29532025-01-22T05:17:53.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2c8b8e02-7233-4211-bfbc-871f7060c417 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29542025-01-22T05:17:53.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2c8b8e02-7233-4211-bfbc-871f7060c417 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29552025-01-22T05:17:53.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2c8b8e02-7233-4211-bfbc-871f7060c417 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29562025-01-22T05:17:54.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 86c11f74-1221-4adb-b506-bf7406e75665 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29572025-01-22T05:17:54.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 86c11f74-1221-4adb-b506-bf7406e75665 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29582025-01-22T05:17:54.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 86c11f74-1221-4adb-b506-bf7406e75665 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29592025-01-22T05:17:55.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 31ca3c62-c91b-4aea-abc4-93aa86cbde8e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29602025-01-22T05:17:55.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 31ca3c62-c91b-4aea-abc4-93aa86cbde8e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29612025-01-22T05:17:55.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 31ca3c62-c91b-4aea-abc4-93aa86cbde8e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29622025-01-22T05:17:55.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 899 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 30ec358a-58cc-4731-9bab-6979232d0009 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
29632025-01-22T05:17:56.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 35d74516-8f7b-4536-97a9-a2c4cb9b5154 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29642025-01-22T05:17:56.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 35d74516-8f7b-4536-97a9-a2c4cb9b5154 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29652025-01-22T05:17:56.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 35d74516-8f7b-4536-97a9-a2c4cb9b5154 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29662025-01-22T05:17:57.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7edafb1f-6b2b-4cb2-917d-8efd4a115780 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29672025-01-22T05:17:57.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7edafb1f-6b2b-4cb2-917d-8efd4a115780 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29682025-01-22T05:17:57.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7edafb1f-6b2b-4cb2-917d-8efd4a115780 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29692025-01-22T05:17:58.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 188ee507-6b13-4829-9f40-44e437fc4404 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29702025-01-22T05:17:58.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 188ee507-6b13-4829-9f40-44e437fc4404 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29712025-01-22T05:17:58.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 188ee507-6b13-4829-9f40-44e437fc4404 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29722025-01-22T05:17:59.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ef08d8b0-7792-4681-b36e-194f8d010e4e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29732025-01-22T05:17:59.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ef08d8b0-7792-4681-b36e-194f8d010e4e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29742025-01-22T05:17:59.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ef08d8b0-7792-4681-b36e-194f8d010e4e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29752025-01-22T05:18:00.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ceb38fcb-e58c-46eb-bd71-769772a41b2a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29762025-01-22T05:18:00.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ceb38fcb-e58c-46eb-bd71-769772a41b2a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29772025-01-22T05:18:00.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ceb38fcb-e58c-46eb-bd71-769772a41b2a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29782025-01-22T05:18:00.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = d1a5dc71-8750-411a-9005-1d762436cbf3 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
29792025-01-22T05:18:00.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = d1a5dc71-8750-411a-9005-1d762436cbf3 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
29802025-01-22T05:18:00.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = d1a5dc71-8750-411a-9005-1d762436cbf3 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
29812025-01-22T05:18:00.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 37f34bc6-e392-4ab1-8193-419b46270624 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
29822025-01-22T05:18:00.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 37f34bc6-e392-4ab1-8193-419b46270624 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
29832025-01-22T05:18:00.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 37f34bc6-e392-4ab1-8193-419b46270624 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
29842025-01-22T05:18:01.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba8ca833-ecd4-4468-bb12-1d9c45fe8893 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29852025-01-22T05:18:01.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba8ca833-ecd4-4468-bb12-1d9c45fe8893 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29862025-01-22T05:18:01.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba8ca833-ecd4-4468-bb12-1d9c45fe8893 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
29872025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
29882025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
29892025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29902025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
29912025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
29922025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29932025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29942025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
29952025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29962025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
29972025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
29982025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
29992025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30002025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30012025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30022025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
30032025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30042025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
30052025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30062025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
30072025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30082025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
30092025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30102025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30112025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
30122025-01-22T05:18:02.822ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30132025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30142025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
30152025-01-22T05:18:02.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30162025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30172025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30182025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30192025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30202025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30212025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30222025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30232025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30242025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30252025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30262025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30272025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30282025-01-22T05:18:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30292025-01-22T05:18:02.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302025-01-22T05:18:02.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30312025-01-22T05:18:02.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30322025-01-22T05:18:02.826ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.251817ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30332025-01-22T05:18:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30342025-01-22T05:18:02.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30352025-01-22T05:18:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30362025-01-22T05:18:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30372025-01-22T05:18:02.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30382025-01-22T05:18:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30392025-01-22T05:18:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30402025-01-22T05:18:02.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30412025-01-22T05:18:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30422025-01-22T05:18:02.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11265, tv_nsec: 180534953 } })
30432025-01-22T05:18:02.831ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30442025-01-22T05:18:02.832ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
30452025-01-22T05:18:02.832ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30462025-01-22T05:18:02.832ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30472025-01-22T05:18:02.832ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30482025-01-22T05:18:02.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30492025-01-22T05:18:02.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30502025-01-22T05:18:02.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30512025-01-22T05:18:02.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30522025-01-22T05:18:02.833ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30532025-01-22T05:18:02.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30542025-01-22T05:18:02.834ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30552025-01-22T05:18:02.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30562025-01-22T05:18:02.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30572025-01-22T05:18:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30582025-01-22T05:18:02.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30592025-01-22T05:18:02.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11265, tv_nsec: 184965183 } })
30602025-01-22T05:18:02.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
30612025-01-22T05:18:02.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30622025-01-22T05:18:02.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.581628ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30632025-01-22T05:18:02.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30642025-01-22T05:18:02.837ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11265, tv_nsec: 186280559 } })
30652025-01-22T05:18:02.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30662025-01-22T05:18:02.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30672025-01-22T05:18:02.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30682025-01-22T05:18:02.837ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
30692025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
30702025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30712025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
30722025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
30732025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30742025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30752025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
30762025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30772025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30782025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30792025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30802025-01-22T05:18:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30812025-01-22T05:18:02.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30822025-01-22T05:18:02.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30832025-01-22T05:18:02.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30842025-01-22T05:18:02.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30852025-01-22T05:18:02.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30862025-01-22T05:18:02.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30872025-01-22T05:18:02.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30882025-01-22T05:18:02.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30892025-01-22T05:18:02.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30902025-01-22T05:18:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30912025-01-22T05:18:02.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.870848ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30922025-01-22T05:18:02.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30932025-01-22T05:18:02.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30942025-01-22T05:18:02.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30952025-01-22T05:18:02.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 36.29848ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
30962025-01-22T05:18:02.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
30972025-01-22T05:18:02.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30982025-01-22T05:18:02.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30992025-01-22T05:18:02.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31002025-01-22T05:18:02.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31012025-01-22T05:18:02.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31022025-01-22T05:18:02.881ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31032025-01-22T05:18:02.881ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31042025-01-22T05:18:02.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31052025-01-22T05:18:02.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31062025-01-22T05:18:02.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31072025-01-22T05:18:02.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31082025-01-22T05:18:02.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31092025-01-22T05:18:02.886ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31102025-01-22T05:18:02.886ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.880811ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31112025-01-22T05:18:02.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31122025-01-22T05:18:02.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31132025-01-22T05:18:02.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31142025-01-22T05:18:02.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31152025-01-22T05:18:02.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31162025-01-22T05:18:02.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = da5abfdb-ef45-4bb2-9f7c-82904747c29b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
31172025-01-22T05:18:02.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = da5abfdb-ef45-4bb2-9f7c-82904747c29b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
31182025-01-22T05:18:02.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31192025-01-22T05:18:02.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31202025-01-22T05:18:02.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31212025-01-22T05:18:02.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.410549ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
31222025-01-22T05:18:02.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31232025-01-22T05:18:02.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31242025-01-22T05:18:02.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = da5abfdb-ef45-4bb2-9f7c-82904747c29b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
31252025-01-22T05:18:02.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31262025-01-22T05:18:02.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31272025-01-22T05:18:02.903ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
31282025-01-22T05:18:02.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.645813ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
31292025-01-22T05:18:02.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31302025-01-22T05:18:02.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
31312025-01-22T05:18:02.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31322025-01-22T05:18:02.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31332025-01-22T05:18:02.927ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.483658ms iteration = 16 status = 0
31342025-01-22T05:18:02.932ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31352025-01-22T05:18:02.932ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31362025-01-22T05:18:02.932ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.510761ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31372025-01-22T05:18:02.934ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
31382025-01-22T05:18:02.934ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31392025-01-22T05:18:02.934ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7be18aa-a5e7-44d3-a8d8-8fe137117ab0", "content-length": "26", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
31402025-01-22T05:18:02.934ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31412025-01-22T05:18:02.935ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31422025-01-22T05:18:02.935ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31432025-01-22T05:18:02.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
31442025-01-22T05:18:02.937ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31452025-01-22T05:18:02.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31462025-01-22T05:18:02.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.71992ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31472025-01-22T05:18:02.943ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31482025-01-22T05:18:02.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31492025-01-22T05:18:02.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31502025-01-22T05:18:02.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31512025-01-22T05:18:02.961ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522025-01-22T05:18:02.962ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31532025-01-22T05:18:02.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31542025-01-22T05:18:02.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31552025-01-22T05:18:02.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31562025-01-22T05:18:02.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31572025-01-22T05:18:02.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31582025-01-22T05:18:02.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31592025-01-22T05:18:02.967ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
31602025-01-22T05:18:02.967ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 144.973743ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
31612025-01-22T05:18:02.974ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 130.770993ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
31622025-01-22T05:18:03.019ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 196.668786ms iteration = 18 status = {"physical_disks_added":0}
31632025-01-22T05:18:03.040ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31642025-01-22T05:18:03.040ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b6f6551-aa49-4b7f-bee4-0d23afde7ca4", "content-length": "1", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
31652025-01-22T05:18:03.043ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31662025-01-22T05:18:03.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31672025-01-22T05:18:03.045ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 222.8768ms iteration = 16 status = null
31682025-01-22T05:18:03.054ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
31692025-01-22T05:18:03.054ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31702025-01-22T05:18:03.055ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e249972-dc16-402a-b78e-d5d412880df6", "content-length": "26", "date": "Wed, 22 Jan 2025 05:18:03 GMT"} })
31712025-01-22T05:18:03.055ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31722025-01-22T05:18:03.057ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31732025-01-22T05:18:03.060ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
31742025-01-22T05:18:03.060ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31752025-01-22T05:18:03.061ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af06c775-b961-41b2-9a38-59d644186737", "content-length": "26", "date": "Wed, 22 Jan 2025 05:18:03 GMT"} })
31762025-01-22T05:18:03.061ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31772025-01-22T05:18:03.062ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
31782025-01-22T05:18:03.078ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31792025-01-22T05:18:03.078ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ba409bd-6e1b-4e25-8308-e4e73460d146", "content-length": "691", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
31802025-01-22T05:18:03.078ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31812025-01-22T05:18:03.078ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31822025-01-22T05:18:03.078ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31832025-01-22T05:18:03.079ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 256.840422ms iteration = 16 status = {}
31842025-01-22T05:18:03.092ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31852025-01-22T05:18:03.092ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31862025-01-22T05:18:03.092ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "474891f6-c6f5-4c51-a6e0-ef7cff539850", "content-length": "372", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
31872025-01-22T05:18:03.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31882025-01-22T05:18:03.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31892025-01-22T05:18:03.132ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
31902025-01-22T05:18:03.132ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31912025-01-22T05:18:03.132ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "803af408-b545-4df4-8b33-5ce61e63c5a4", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
31922025-01-22T05:18:03.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31932025-01-22T05:18:03.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31942025-01-22T05:18:03.133ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 310.563156ms iteration = 16 status = {}
31952025-01-22T05:18:03.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31962025-01-22T05:18:03.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31972025-01-22T05:18:03.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31982025-01-22T05:18:03.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31992025-01-22T05:18:03.141ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32002025-01-22T05:18:03.141ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32012025-01-22T05:18:03.141ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b04e492f-aa97-4df1-b205-67cc5edcf3a0", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
32022025-01-22T05:18:03.142ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.714773ms iteration = 16 status = {}
32032025-01-22T05:18:03.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32042025-01-22T05:18:03.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32052025-01-22T05:18:03.198ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
32062025-01-22T05:18:03.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32072025-01-22T05:18:03.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32082025-01-22T05:18:03.207ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32092025-01-22T05:18:03.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4fa2d9b-c142-43c2-a273-017fa316ae4e", "content-length": "134", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
32102025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32112025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
32122025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32132025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32142025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32152025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32162025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32172025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32182025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32192025-01-22T05:18:03.207ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32202025-01-22T05:18:03.208ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
32212025-01-22T05:18:03.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32222025-01-22T05:18:03.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32232025-01-22T05:18:03.209ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32242025-01-22T05:18:03.214ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "af6c0370-96db-4cc9-b2ec-b4ce0bccdd2f", "content-length": "2", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
32252025-01-22T05:18:03.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32262025-01-22T05:18:03.214ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "96e95ce5-536d-4822-abb9-c6fadc8ecee5", "content-length": "51", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
32272025-01-22T05:18:03.214ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
32282025-01-22T05:18:03.214ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32292025-01-22T05:18:03.309ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2ec20719-81cd-4d6e-9837-1215e2036362", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
32302025-01-22T05:18:03.309ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
32312025-01-22T05:18:03.309ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32322025-01-22T05:18:03.313ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1d78af5-c4cc-4104-9387-751d59747f90", "content-length": "682", "date": "Wed, 22 Jan 2025 05:18:02 GMT"} })
32332025-01-22T05:18:03.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32342025-01-22T05:18:03.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32352025-01-22T05:18:03.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32362025-01-22T05:18:03.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32372025-01-22T05:18:03.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32382025-01-22T05:18:03.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32392025-01-22T05:18:03.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32402025-01-22T05:18:03.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32412025-01-22T05:18:03.329ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 507.159682ms iteration = 16 status = {}
32422025-01-22T05:18:03.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8ea7548e-ea1e-4d92-b6a8-fd0040112f18 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32432025-01-22T05:18:03.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8ea7548e-ea1e-4d92-b6a8-fd0040112f18 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32442025-01-22T05:18:03.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8ea7548e-ea1e-4d92-b6a8-fd0040112f18 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32452025-01-22T05:18:04.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = a08d8452-0fdf-4f28-ac48-8beb6b71ef5f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32462025-01-22T05:18:04.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = a08d8452-0fdf-4f28-ac48-8beb6b71ef5f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32472025-01-22T05:18:04.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = a08d8452-0fdf-4f28-ac48-8beb6b71ef5f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32482025-01-22T05:18:04.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 33429b9c-b932-4a67-af8a-65f9e83b15ff roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32492025-01-22T05:18:04.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 33429b9c-b932-4a67-af8a-65f9e83b15ff resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32502025-01-22T05:18:04.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 33429b9c-b932-4a67-af8a-65f9e83b15ff response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32512025-01-22T05:18:05.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 51e5b950-87b2-4349-b4de-1bb37d073928 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32522025-01-22T05:18:05.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 51e5b950-87b2-4349-b4de-1bb37d073928 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32532025-01-22T05:18:05.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 51e5b950-87b2-4349-b4de-1bb37d073928 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32542025-01-22T05:18:05.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 692 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = a748a34f-49c9-4d5b-a725-efe938ca9848 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
32552025-01-22T05:18:06.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bc16ea27-9d6c-486c-97b1-12e85b0891f4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32562025-01-22T05:18:06.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bc16ea27-9d6c-486c-97b1-12e85b0891f4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32572025-01-22T05:18:06.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bc16ea27-9d6c-486c-97b1-12e85b0891f4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32582025-01-22T05:18:08.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 66942794-2ed3-4199-96ed-7a35c9d12e43 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32592025-01-22T05:18:08.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 66942794-2ed3-4199-96ed-7a35c9d12e43 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32602025-01-22T05:18:08.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 66942794-2ed3-4199-96ed-7a35c9d12e43 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32612025-01-22T05:18:09.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b2496fa6-0a7b-4bc3-9e79-e281b504a318 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32622025-01-22T05:18:09.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b2496fa6-0a7b-4bc3-9e79-e281b504a318 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32632025-01-22T05:18:09.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b2496fa6-0a7b-4bc3-9e79-e281b504a318 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32642025-01-22T05:18:10.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 736224dc-0873-4bdd-9032-4fdb6b4c1723 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32652025-01-22T05:18:10.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 736224dc-0873-4bdd-9032-4fdb6b4c1723 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32662025-01-22T05:18:10.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 736224dc-0873-4bdd-9032-4fdb6b4c1723 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32672025-01-22T05:18:11.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 13714756-722f-4a8a-8a07-ff148a3abfba roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32682025-01-22T05:18:11.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 13714756-722f-4a8a-8a07-ff148a3abfba resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32692025-01-22T05:18:11.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 13714756-722f-4a8a-8a07-ff148a3abfba response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32702025-01-22T05:18:12.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 93f7a82b-2298-468a-b5d2-975bbd131ea5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32712025-01-22T05:18:12.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 93f7a82b-2298-468a-b5d2-975bbd131ea5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32722025-01-22T05:18:12.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 93f7a82b-2298-468a-b5d2-975bbd131ea5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32732025-01-22T05:18:12.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
32742025-01-22T05:18:12.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32752025-01-22T05:18:12.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32762025-01-22T05:18:12.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
32772025-01-22T05:18:12.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32782025-01-22T05:18:12.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32792025-01-22T05:18:12.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32802025-01-22T05:18:12.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32812025-01-22T05:18:12.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32822025-01-22T05:18:12.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.362189ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32832025-01-22T05:18:12.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32842025-01-22T05:18:12.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32852025-01-22T05:18:12.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32862025-01-22T05:18:12.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32872025-01-22T05:18:12.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32882025-01-22T05:18:12.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32892025-01-22T05:18:12.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
32902025-01-22T05:18:12.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32912025-01-22T05:18:12.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32922025-01-22T05:18:12.848ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
32932025-01-22T05:18:12.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.317825ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
32942025-01-22T05:18:13.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 83ee3caa-cf20-4d57-85f2-219e4920d628 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32952025-01-22T05:18:13.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 83ee3caa-cf20-4d57-85f2-219e4920d628 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32962025-01-22T05:18:13.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 83ee3caa-cf20-4d57-85f2-219e4920d628 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32972025-01-22T05:18:14.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1bb8f0e9-af31-4e3c-9e93-8c86c56e28f4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32982025-01-22T05:18:14.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1bb8f0e9-af31-4e3c-9e93-8c86c56e28f4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
32992025-01-22T05:18:14.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1bb8f0e9-af31-4e3c-9e93-8c86c56e28f4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33002025-01-22T05:18:15.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a2838282-8a43-480a-969a-99897a5aa629 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33012025-01-22T05:18:15.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a2838282-8a43-480a-969a-99897a5aa629 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33022025-01-22T05:18:15.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a2838282-8a43-480a-969a-99897a5aa629 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33032025-01-22T05:18:15.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 482 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = fab109ae-9081-403f-a1ee-0d8f80797a0d response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
33042025-01-22T05:18:16.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aacccdde-c084-4401-b234-c772cee9482b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33052025-01-22T05:18:16.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aacccdde-c084-4401-b234-c772cee9482b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33062025-01-22T05:18:16.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aacccdde-c084-4401-b234-c772cee9482b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33072025-01-22T05:18:17.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 87f66f46-9510-4d5e-ae25-e868998cdc0b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33082025-01-22T05:18:17.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 87f66f46-9510-4d5e-ae25-e868998cdc0b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33092025-01-22T05:18:17.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 87f66f46-9510-4d5e-ae25-e868998cdc0b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33102025-01-22T05:18:18.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c2b67442-d28e-46d0-bbcd-cd06caf7ac78 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33112025-01-22T05:18:18.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c2b67442-d28e-46d0-bbcd-cd06caf7ac78 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33122025-01-22T05:18:18.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c2b67442-d28e-46d0-bbcd-cd06caf7ac78 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33132025-01-22T05:18:19.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5c19abf3-1852-4cb9-a919-141b6a6ccfc2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33142025-01-22T05:18:19.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5c19abf3-1852-4cb9-a919-141b6a6ccfc2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33152025-01-22T05:18:19.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5c19abf3-1852-4cb9-a919-141b6a6ccfc2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33162025-01-22T05:18:20.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 00a32c36-93e0-448a-8a35-14aa0978c961 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33172025-01-22T05:18:20.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 00a32c36-93e0-448a-8a35-14aa0978c961 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33182025-01-22T05:18:20.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 00a32c36-93e0-448a-8a35-14aa0978c961 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33192025-01-22T05:18:21.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 974cdf36-deb7-4891-91f9-5f1d201e4ab6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33202025-01-22T05:18:21.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 974cdf36-deb7-4891-91f9-5f1d201e4ab6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33212025-01-22T05:18:21.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 974cdf36-deb7-4891-91f9-5f1d201e4ab6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33222025-01-22T05:18:22.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6e2d811c-ef09-4642-b339-8f57d1e4ff0a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33232025-01-22T05:18:22.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6e2d811c-ef09-4642-b339-8f57d1e4ff0a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33242025-01-22T05:18:22.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6e2d811c-ef09-4642-b339-8f57d1e4ff0a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33252025-01-22T05:18:22.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
33262025-01-22T05:18:22.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33272025-01-22T05:18:22.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33282025-01-22T05:18:22.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
33292025-01-22T05:18:22.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33302025-01-22T05:18:22.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33312025-01-22T05:18:22.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33322025-01-22T05:18:22.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33332025-01-22T05:18:22.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33342025-01-22T05:18:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33352025-01-22T05:18:22.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33362025-01-22T05:18:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33372025-01-22T05:18:22.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.613483ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33382025-01-22T05:18:22.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33392025-01-22T05:18:22.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33402025-01-22T05:18:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33412025-01-22T05:18:22.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
33422025-01-22T05:18:22.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33432025-01-22T05:18:22.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33442025-01-22T05:18:22.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
33452025-01-22T05:18:22.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.410386ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
33462025-01-22T05:18:23.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1b70ca20-3537-44e0-b991-ad3c6461e099 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33472025-01-22T05:18:23.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1b70ca20-3537-44e0-b991-ad3c6461e099 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33482025-01-22T05:18:23.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1b70ca20-3537-44e0-b991-ad3c6461e099 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33492025-01-22T05:18:24.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 90615239-53a0-4964-a72a-9d2d66073939 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33502025-01-22T05:18:24.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 90615239-53a0-4964-a72a-9d2d66073939 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33512025-01-22T05:18:24.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 90615239-53a0-4964-a72a-9d2d66073939 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33522025-01-22T05:18:25.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 542281c4-f0bb-44cb-8b27-9575dd9df799 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33532025-01-22T05:18:25.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 542281c4-f0bb-44cb-8b27-9575dd9df799 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33542025-01-22T05:18:25.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 542281c4-f0bb-44cb-8b27-9575dd9df799 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33552025-01-22T05:18:25.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 546 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 7131ec46-9767-41a8-a93d-74cf25d996ac response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
33562025-01-22T05:18:26.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c5ad6225-e717-4c1b-9d62-48746dcc40af roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33572025-01-22T05:18:26.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c5ad6225-e717-4c1b-9d62-48746dcc40af resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33582025-01-22T05:18:26.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c5ad6225-e717-4c1b-9d62-48746dcc40af response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33592025-01-22T05:18:27.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb9ce85c-9c7e-4304-b02a-a2181fc98060 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33602025-01-22T05:18:27.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb9ce85c-9c7e-4304-b02a-a2181fc98060 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33612025-01-22T05:18:27.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb9ce85c-9c7e-4304-b02a-a2181fc98060 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33622025-01-22T05:18:28.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ade8a8fe-31ca-4cfd-aeec-eb76d8d9e228 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33632025-01-22T05:18:28.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ade8a8fe-31ca-4cfd-aeec-eb76d8d9e228 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33642025-01-22T05:18:28.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ade8a8fe-31ca-4cfd-aeec-eb76d8d9e228 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33652025-01-22T05:18:29.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 64009d0a-bf13-4dc8-bd7d-1d1a42e41758 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33662025-01-22T05:18:29.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 64009d0a-bf13-4dc8-bd7d-1d1a42e41758 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33672025-01-22T05:18:29.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 64009d0a-bf13-4dc8-bd7d-1d1a42e41758 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33682025-01-22T05:18:30.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 34ae4f54-c454-4952-9a98-d1aeb71420f4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33692025-01-22T05:18:30.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 34ae4f54-c454-4952-9a98-d1aeb71420f4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33702025-01-22T05:18:30.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 34ae4f54-c454-4952-9a98-d1aeb71420f4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33712025-01-22T05:18:31.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = df3e445d-66d0-444b-86f2-96d76bc28f83 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33722025-01-22T05:18:31.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = df3e445d-66d0-444b-86f2-96d76bc28f83 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33732025-01-22T05:18:31.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = df3e445d-66d0-444b-86f2-96d76bc28f83 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33742025-01-22T05:18:32.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb166ad6-ea6e-49b5-a890-bf59a97a211c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33752025-01-22T05:18:32.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb166ad6-ea6e-49b5-a890-bf59a97a211c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33762025-01-22T05:18:32.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eb166ad6-ea6e-49b5-a890-bf59a97a211c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
33772025-01-22T05:18:32.822ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
33782025-01-22T05:18:32.822ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33792025-01-22T05:18:32.822ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
33802025-01-22T05:18:32.822ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33812025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33822025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
33832025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
33842025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
33852025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33862025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
33872025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33882025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
33892025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
33902025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33912025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
33922025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33932025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
33942025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33952025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33962025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
33972025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
33982025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33992025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
34002025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34012025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
34022025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
34032025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
34042025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
34052025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34062025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
34072025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
34082025-01-22T05:18:32.823ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:08:32.823163329 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
34092025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34102025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
34112025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
34122025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
34132025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
34142025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34152025-01-22T05:18:32.823ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
34162025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.79\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
34172025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
34182025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
34192025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
34202025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34212025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
34222025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34232025-01-22T05:18:32.823ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34242025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
34252025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34262025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
34272025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34282025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34292025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
34302025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34312025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34322025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34332025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34342025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34352025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34362025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34372025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34382025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34392025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34402025-01-22T05:18:32.823ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11295, tv_nsec: 172198633 } })
34412025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34422025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34432025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34442025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34452025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34462025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34472025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34482025-01-22T05:18:32.823ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11295, tv_nsec: 172333746 } })
34492025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34502025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
34512025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34522025-01-22T05:18:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34532025-01-22T05:18:32.824ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
34542025-01-22T05:18:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.025581ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
34552025-01-22T05:18:32.824ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
34562025-01-22T05:18:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.122042ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
34572025-01-22T05:18:32.825ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34582025-01-22T05:18:32.826ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34592025-01-22T05:18:32.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34602025-01-22T05:18:32.827ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.303618ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34612025-01-22T05:18:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34622025-01-22T05:18:32.828ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34632025-01-22T05:18:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34642025-01-22T05:18:32.828ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34652025-01-22T05:18:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34662025-01-22T05:18:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34672025-01-22T05:18:32.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34682025-01-22T05:18:32.828ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34692025-01-22T05:18:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34702025-01-22T05:18:32.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34712025-01-22T05:18:32.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34722025-01-22T05:18:32.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34732025-01-22T05:18:32.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34742025-01-22T05:18:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34752025-01-22T05:18:32.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11295, tv_nsec: 180105054 } })
34762025-01-22T05:18:32.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
34772025-01-22T05:18:32.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782025-01-22T05:18:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34792025-01-22T05:18:32.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34802025-01-22T05:18:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34812025-01-22T05:18:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34822025-01-22T05:18:32.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34832025-01-22T05:18:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34842025-01-22T05:18:32.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34852025-01-22T05:18:32.838ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11295, tv_nsec: 186640837 } })
34862025-01-22T05:18:32.838ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
34872025-01-22T05:18:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34882025-01-22T05:18:32.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34892025-01-22T05:18:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34902025-01-22T05:18:32.840ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34912025-01-22T05:18:32.840ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34922025-01-22T05:18:32.840ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.143479ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34932025-01-22T05:18:32.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34942025-01-22T05:18:32.842ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:08:32.823163329 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34952025-01-22T05:18:32.842ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.057188ms iteration = 9 status = {"expiration":"2025-01-22T05:08:32.823163329Z","pruned":[]}
34962025-01-22T05:18:32.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34972025-01-22T05:18:32.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34982025-01-22T05:18:32.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34992025-01-22T05:18:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35002025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
35012025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
35022025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35032025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
35042025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35052025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35062025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
35072025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
35082025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35092025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
35102025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35112025-01-22T05:18:32.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35122025-01-22T05:18:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35132025-01-22T05:18:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
35142025-01-22T05:18:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35152025-01-22T05:18:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35162025-01-22T05:18:32.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35172025-01-22T05:18:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35182025-01-22T05:18:32.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35192025-01-22T05:18:32.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35202025-01-22T05:18:32.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35212025-01-22T05:18:32.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35222025-01-22T05:18:32.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35232025-01-22T05:18:32.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35242025-01-22T05:18:32.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35252025-01-22T05:18:32.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35262025-01-22T05:18:32.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35272025-01-22T05:18:32.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35282025-01-22T05:18:32.865ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.567599ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
35292025-01-22T05:18:32.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35302025-01-22T05:18:32.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35312025-01-22T05:18:32.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35322025-01-22T05:18:32.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35332025-01-22T05:18:32.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35342025-01-22T05:18:32.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35352025-01-22T05:18:32.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35362025-01-22T05:18:32.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35372025-01-22T05:18:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35382025-01-22T05:18:32.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
35392025-01-22T05:18:32.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35402025-01-22T05:18:32.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35412025-01-22T05:18:32.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35422025-01-22T05:18:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35432025-01-22T05:18:32.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35442025-01-22T05:18:32.899ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35452025-01-22T05:18:32.899ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35462025-01-22T05:18:32.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35472025-01-22T05:18:32.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35482025-01-22T05:18:32.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35492025-01-22T05:18:32.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35502025-01-22T05:18:32.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35512025-01-22T05:18:32.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11295, tv_nsec: 251745613 } })
35522025-01-22T05:18:32.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
35532025-01-22T05:18:32.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.560851ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35542025-01-22T05:18:32.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35552025-01-22T05:18:32.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35562025-01-22T05:18:32.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35572025-01-22T05:18:32.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35582025-01-22T05:18:32.912ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35592025-01-22T05:18:32.912ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35602025-01-22T05:18:32.912ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 89.443442ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35612025-01-22T05:18:32.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35622025-01-22T05:18:32.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35632025-01-22T05:18:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35642025-01-22T05:18:32.913ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35652025-01-22T05:18:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35662025-01-22T05:18:32.915ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 92.232499ms iteration = 19 status = {"physical_disks_added":0}
35672025-01-22T05:18:32.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35682025-01-22T05:18:32.915ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35692025-01-22T05:18:32.915ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
35702025-01-22T05:18:32.915ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.510274ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
35712025-01-22T05:18:32.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35722025-01-22T05:18:32.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.66329ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
35732025-01-22T05:18:32.917ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35742025-01-22T05:18:32.917ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35752025-01-22T05:18:32.917ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35762025-01-22T05:18:32.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35772025-01-22T05:18:32.917ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35782025-01-22T05:18:32.917ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35792025-01-22T05:18:32.917ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35802025-01-22T05:18:32.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35812025-01-22T05:18:32.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35822025-01-22T05:18:32.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35832025-01-22T05:18:32.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35842025-01-22T05:18:32.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35852025-01-22T05:18:32.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35862025-01-22T05:18:32.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.734402ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
35872025-01-22T05:18:32.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35882025-01-22T05:18:32.921ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35892025-01-22T05:18:32.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35902025-01-22T05:18:32.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35912025-01-22T05:18:32.924ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35922025-01-22T05:18:32.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35932025-01-22T05:18:32.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35942025-01-22T05:18:32.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35952025-01-22T05:18:32.925ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35962025-01-22T05:18:32.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35972025-01-22T05:18:32.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35982025-01-22T05:18:32.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35992025-01-22T05:18:32.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36002025-01-22T05:18:32.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36012025-01-22T05:18:32.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36022025-01-22T05:18:32.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36032025-01-22T05:18:32.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36042025-01-22T05:18:32.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36052025-01-22T05:18:32.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36062025-01-22T05:18:32.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36072025-01-22T05:18:32.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
36082025-01-22T05:18:32.929ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36092025-01-22T05:18:32.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36102025-01-22T05:18:32.930ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
36112025-01-22T05:18:32.930ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36122025-01-22T05:18:32.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
36132025-01-22T05:18:32.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36142025-01-22T05:18:32.932ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36152025-01-22T05:18:32.932ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.4833ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36162025-01-22T05:18:32.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.104963ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36172025-01-22T05:18:32.940ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36182025-01-22T05:18:32.956ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36192025-01-22T05:18:32.956ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36202025-01-22T05:18:32.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36212025-01-22T05:18:32.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36222025-01-22T05:18:32.959ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36232025-01-22T05:18:32.964ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36242025-01-22T05:18:32.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36252025-01-22T05:18:32.994ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
36262025-01-22T05:18:32.994ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36272025-01-22T05:18:32.994ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e686b34-edf3-4926-9580-ed589a081985", "content-length": "26", "date": "Wed, 22 Jan 2025 05:18:32 GMT"} })
36282025-01-22T05:18:32.994ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36292025-01-22T05:18:32.995ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36302025-01-22T05:18:33.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
36312025-01-22T05:18:33.035ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36322025-01-22T05:18:33.035ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bb5cf11-506d-4751-864e-1faec4773a6a", "content-length": "26", "date": "Wed, 22 Jan 2025 05:18:32 GMT"} })
36332025-01-22T05:18:33.035ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36342025-01-22T05:18:33.037ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36352025-01-22T05:18:33.085ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36362025-01-22T05:18:33.086ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36372025-01-22T05:18:33.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36382025-01-22T05:18:33.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36392025-01-22T05:18:33.102ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecf2402f-30ee-4c08-9b22-ee6742bbe387", "content-length": "372", "date": "Wed, 22 Jan 2025 05:18:32 GMT"} })
36402025-01-22T05:18:33.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36412025-01-22T05:18:33.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36422025-01-22T05:18:33.105ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
36432025-01-22T05:18:33.106ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "26ab0d13-95a1-4922-96e5-1509d5c9b5d3", "date": "Wed, 22 Jan 2025 05:18:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36442025-01-22T05:18:33.106ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36452025-01-22T05:18:33.107ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1ab62df4-0c20-4811-8959-89279e234548", "date": "Wed, 22 Jan 2025 05:18:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36462025-01-22T05:18:33.107ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36472025-01-22T05:18:33.114ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36482025-01-22T05:18:33.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 291.57568ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36492025-01-22T05:18:33.123ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
36502025-01-22T05:18:33.123ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36512025-01-22T05:18:33.123ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ac48812-465f-4450-a3d9-2ac0cf5ae774", "content-length": "26", "date": "Wed, 22 Jan 2025 05:18:32 GMT"} })
36522025-01-22T05:18:33.123ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36532025-01-22T05:18:33.126ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
36542025-01-22T05:18:33.127ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36552025-01-22T05:18:33.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36562025-01-22T05:18:33.129ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36572025-01-22T05:18:33.129ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
36582025-01-22T05:18:33.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36592025-01-22T05:18:33.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36602025-01-22T05:18:33.130ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36612025-01-22T05:18:33.131ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
36622025-01-22T05:18:33.131ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 308.940304ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36632025-01-22T05:18:33.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 288.345014ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36642025-01-22T05:18:33.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 288.492457ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
36652025-01-22T05:18:33.134ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36662025-01-22T05:18:33.134ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36672025-01-22T05:18:33.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36682025-01-22T05:18:33.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36692025-01-22T05:18:33.136ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36702025-01-22T05:18:33.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36712025-01-22T05:18:33.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36722025-01-22T05:18:33.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36732025-01-22T05:18:33.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36742025-01-22T05:18:33.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
36752025-01-22T05:18:33.140ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36762025-01-22T05:18:33.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36772025-01-22T05:18:33.142ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36782025-01-22T05:18:33.142ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36792025-01-22T05:18:33.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 319.09501ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36802025-01-22T05:18:33.142ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 319.551989ms iteration = 17 status = 0
36812025-01-22T05:18:33.142ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
36822025-01-22T05:18:33.142ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36832025-01-22T05:18:33.142ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
36842025-01-22T05:18:33.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 319.737213ms iteration = 9 status = {"generation":1}
36852025-01-22T05:18:33.147ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.958649ms iteration = 17 status = {}
36862025-01-22T05:18:33.156ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36872025-01-22T05:18:33.156ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36882025-01-22T05:18:33.156ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6a167732-7ff2-476f-9eed-aa62244202d4", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} })
36892025-01-22T05:18:33.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36902025-01-22T05:18:33.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36912025-01-22T05:18:33.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36922025-01-22T05:18:33.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36932025-01-22T05:18:33.159ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36942025-01-22T05:18:33.159ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "61f84e09-4039-4c4d-9f22-011e75273126", "content-length": "1", "date": "Wed, 22 Jan 2025 05:18:32 GMT"} })
36952025-01-22T05:18:33.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36962025-01-22T05:18:33.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36972025-01-22T05:18:33.161ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36982025-01-22T05:18:33.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36992025-01-22T05:18:33.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37002025-01-22T05:18:33.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
37012025-01-22T05:18:33.162ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37022025-01-22T05:18:33.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37032025-01-22T05:18:33.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37042025-01-22T05:18:33.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37052025-01-22T05:18:33.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37062025-01-22T05:18:33.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37072025-01-22T05:18:33.165ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 342.998647ms iteration = 17 status = null
37082025-01-22T05:18:33.167ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
37092025-01-22T05:18:33.167ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
37102025-01-22T05:18:33.167ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
37112025-01-22T05:18:33.167ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 343.896195ms iteration = 9 status = {"generation":2}
37122025-01-22T05:18:33.167ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37132025-01-22T05:18:33.167ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37142025-01-22T05:18:33.168ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "16f0cca2-fa5b-4153-8e71-331cce05ea16", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} })
37152025-01-22T05:18:33.170ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 347.121972ms iteration = 17 status = {}
37162025-01-22T05:18:33.198ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
37172025-01-22T05:18:33.198ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 375.421177ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
37182025-01-22T05:18:33.201ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
37192025-01-22T05:18:33.201ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2aa3b41e-8be9-4add-93c2-1f50fff47327", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37202025-01-22T05:18:33.202ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37212025-01-22T05:18:33.204ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
37222025-01-22T05:18:33.204ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 380.985161ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
37232025-01-22T05:18:33.204ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "541a11f6-b021-43f2-a200-a6eb8097ca89", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37242025-01-22T05:18:33.204ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37252025-01-22T05:18:33.206ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ee345a36-f8b8-4bf5-bd3c-a8ecc9204778", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37262025-01-22T05:18:33.206ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37272025-01-22T05:18:33.209ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37282025-01-22T05:18:33.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 386.194197ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37292025-01-22T05:18:33.233ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37302025-01-22T05:18:33.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37312025-01-22T05:18:33.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37322025-01-22T05:18:33.279ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
37332025-01-22T05:18:33.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37342025-01-22T05:18:33.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37352025-01-22T05:18:33.288ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37362025-01-22T05:18:33.288ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "92db6735-e697-46cd-98df-a0d35c497bb3", "content-length": "134", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} })
37372025-01-22T05:18:33.288ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37382025-01-22T05:18:33.288ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
37392025-01-22T05:18:33.289ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37402025-01-22T05:18:33.289ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37412025-01-22T05:18:33.289ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37422025-01-22T05:18:33.289ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37432025-01-22T05:18:33.289ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37442025-01-22T05:18:33.289ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37452025-01-22T05:18:33.289ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37462025-01-22T05:18:33.289ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37472025-01-22T05:18:33.289ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
37482025-01-22T05:18:33.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37492025-01-22T05:18:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37502025-01-22T05:18:33.291ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37512025-01-22T05:18:33.291ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a76368aa-4adf-44b5-b13b-65df1e7d7999", "content-length": "2", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} })
37522025-01-22T05:18:33.291ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37532025-01-22T05:18:33.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "112511c0-3f59-4390-8c8d-6756e4889e76", "content-length": "51", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} })
37542025-01-22T05:18:33.292ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
37552025-01-22T05:18:33.292ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37562025-01-22T05:18:33.328ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "71710b37-cfa4-4e04-9ec6-f884c44d2505", "content-length": "691", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} })
37572025-01-22T05:18:33.328ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37582025-01-22T05:18:33.328ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37592025-01-22T05:18:33.328ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37602025-01-22T05:18:33.330ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 507.553519ms iteration = 17 status = {}
37612025-01-22T05:18:33.432ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5b5a6b38-03f6-4898-b3aa-5d6d20ccb523", "date": "Wed, 22 Jan 2025 05:18:32 GMT"} })
37622025-01-22T05:18:33.432ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
37632025-01-22T05:18:33.432ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37642025-01-22T05:18:33.433ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "38da3813-6107-4662-87d5-4219fbb44904", "content-length": "682", "date": "Wed, 22 Jan 2025 05:18:33 GMT"} })
37652025-01-22T05:18:33.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37662025-01-22T05:18:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37672025-01-22T05:18:33.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37682025-01-22T05:18:33.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37692025-01-22T05:18:33.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37702025-01-22T05:18:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37712025-01-22T05:18:33.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37722025-01-22T05:18:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37732025-01-22T05:18:33.449ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.154515ms iteration = 17 status = {}
37742025-01-22T05:18:33.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 07704d27-1d13-4649-850a-975341f95534 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37752025-01-22T05:18:33.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 07704d27-1d13-4649-850a-975341f95534 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37762025-01-22T05:18:33.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 07704d27-1d13-4649-850a-975341f95534 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37772025-01-22T05:18:33.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 8a5d5887-7c4c-4c9c-bcb2-950575b00274 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37782025-01-22T05:18:33.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 8a5d5887-7c4c-4c9c-bcb2-950575b00274 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37792025-01-22T05:18:33.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 8a5d5887-7c4c-4c9c-bcb2-950575b00274 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37802025-01-22T05:18:34.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d6a0bd3e-9226-42a2-95cd-2010feb09af8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37812025-01-22T05:18:34.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d6a0bd3e-9226-42a2-95cd-2010feb09af8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37822025-01-22T05:18:34.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d6a0bd3e-9226-42a2-95cd-2010feb09af8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37832025-01-22T05:18:35.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 41c565de-1e1c-4c81-9051-88d526d0b73a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37842025-01-22T05:18:35.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 41c565de-1e1c-4c81-9051-88d526d0b73a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37852025-01-22T05:18:35.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 41c565de-1e1c-4c81-9051-88d526d0b73a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37862025-01-22T05:18:35.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 530 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 9786f66d-b945-4a72-bcc6-9f723219bed8 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
37872025-01-22T05:18:36.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b9b6827b-5b0e-42ee-9db1-5a380e89bcae roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37882025-01-22T05:18:36.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b9b6827b-5b0e-42ee-9db1-5a380e89bcae resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37892025-01-22T05:18:36.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b9b6827b-5b0e-42ee-9db1-5a380e89bcae response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37902025-01-22T05:18:37.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a5d60be2-790c-413a-9a52-5c5b9cb1ae83 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37912025-01-22T05:18:37.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a5d60be2-790c-413a-9a52-5c5b9cb1ae83 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37922025-01-22T05:18:37.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a5d60be2-790c-413a-9a52-5c5b9cb1ae83 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37932025-01-22T05:18:38.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0f25b217-5de5-465e-9404-dc4c4fe65d1b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37942025-01-22T05:18:38.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0f25b217-5de5-465e-9404-dc4c4fe65d1b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37952025-01-22T05:18:38.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0f25b217-5de5-465e-9404-dc4c4fe65d1b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37962025-01-22T05:18:39.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 96d7d473-81a9-40e1-aba1-2effa372d63f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37972025-01-22T05:18:39.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 96d7d473-81a9-40e1-aba1-2effa372d63f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37982025-01-22T05:18:39.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 96d7d473-81a9-40e1-aba1-2effa372d63f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
37992025-01-22T05:18:40.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 59cd89f7-eb24-4659-95bd-79dce8b52473 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38002025-01-22T05:18:40.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 59cd89f7-eb24-4659-95bd-79dce8b52473 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38012025-01-22T05:18:40.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 59cd89f7-eb24-4659-95bd-79dce8b52473 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38022025-01-22T05:18:41.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ea6d12f4-a369-4382-a3fa-a67e31595535 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38032025-01-22T05:18:41.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ea6d12f4-a369-4382-a3fa-a67e31595535 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38042025-01-22T05:18:41.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ea6d12f4-a369-4382-a3fa-a67e31595535 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38052025-01-22T05:18:42.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72ebc839-7d3b-4149-b3f2-48bf5bb01b8e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38062025-01-22T05:18:42.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72ebc839-7d3b-4149-b3f2-48bf5bb01b8e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38072025-01-22T05:18:42.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72ebc839-7d3b-4149-b3f2-48bf5bb01b8e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38082025-01-22T05:18:42.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
38092025-01-22T05:18:42.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38102025-01-22T05:18:42.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38112025-01-22T05:18:42.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
38122025-01-22T05:18:42.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38132025-01-22T05:18:42.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38142025-01-22T05:18:42.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38152025-01-22T05:18:42.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38162025-01-22T05:18:42.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38172025-01-22T05:18:42.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38182025-01-22T05:18:42.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38192025-01-22T05:18:42.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38202025-01-22T05:18:42.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38212025-01-22T05:18:42.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
38222025-01-22T05:18:42.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38232025-01-22T05:18:42.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38242025-01-22T05:18:42.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
38252025-01-22T05:18:42.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.17711ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
38262025-01-22T05:18:42.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38272025-01-22T05:18:42.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38282025-01-22T05:18:42.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.47186ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38292025-01-22T05:18:43.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ad7734fb-9c77-44a5-97ad-b8f8cf8229b6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38302025-01-22T05:18:43.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ad7734fb-9c77-44a5-97ad-b8f8cf8229b6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38312025-01-22T05:18:43.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ad7734fb-9c77-44a5-97ad-b8f8cf8229b6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38322025-01-22T05:18:44.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 93e10a81-e8dc-4c55-9b07-369e4119ce9c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38332025-01-22T05:18:44.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 93e10a81-e8dc-4c55-9b07-369e4119ce9c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38342025-01-22T05:18:44.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 93e10a81-e8dc-4c55-9b07-369e4119ce9c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38352025-01-22T05:18:45.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c6355eaa-8a3e-4d93-a498-621f4f6f0e2a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38362025-01-22T05:18:45.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c6355eaa-8a3e-4d93-a498-621f4f6f0e2a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38372025-01-22T05:18:45.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c6355eaa-8a3e-4d93-a498-621f4f6f0e2a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38382025-01-22T05:18:45.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 468 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 7fc41ca0-9deb-4520-896c-2592914a16aa response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
38392025-01-22T05:18:46.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f75e21f1-a9bb-4aea-9989-45bf2be2f771 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38402025-01-22T05:18:46.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f75e21f1-a9bb-4aea-9989-45bf2be2f771 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38412025-01-22T05:18:46.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f75e21f1-a9bb-4aea-9989-45bf2be2f771 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38422025-01-22T05:18:47.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 21d54f22-0e1b-4e6c-8115-eebecb10a16f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38432025-01-22T05:18:47.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 21d54f22-0e1b-4e6c-8115-eebecb10a16f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38442025-01-22T05:18:47.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 21d54f22-0e1b-4e6c-8115-eebecb10a16f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38452025-01-22T05:18:48.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dcb5cd54-a882-4e5a-9ab1-70eedaafbb6a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38462025-01-22T05:18:48.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dcb5cd54-a882-4e5a-9ab1-70eedaafbb6a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38472025-01-22T05:18:48.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dcb5cd54-a882-4e5a-9ab1-70eedaafbb6a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38482025-01-22T05:18:49.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5b15a28c-222e-4def-8c8b-ade293c815d0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38492025-01-22T05:18:49.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5b15a28c-222e-4def-8c8b-ade293c815d0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38502025-01-22T05:18:49.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5b15a28c-222e-4def-8c8b-ade293c815d0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38512025-01-22T05:18:50.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 75ce75d5-457b-4a57-880b-04221968db80 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38522025-01-22T05:18:50.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 75ce75d5-457b-4a57-880b-04221968db80 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38532025-01-22T05:18:50.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 75ce75d5-457b-4a57-880b-04221968db80 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38542025-01-22T05:18:51.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2a51867a-ac83-4cb6-8bfa-23887947a43b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38552025-01-22T05:18:51.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2a51867a-ac83-4cb6-8bfa-23887947a43b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38562025-01-22T05:18:51.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2a51867a-ac83-4cb6-8bfa-23887947a43b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38572025-01-22T05:18:52.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
38582025-01-22T05:18:52.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38592025-01-22T05:18:52.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38602025-01-22T05:18:52.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
38612025-01-22T05:18:52.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38622025-01-22T05:18:52.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38632025-01-22T05:18:52.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38642025-01-22T05:18:52.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38652025-01-22T05:18:52.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38662025-01-22T05:18:52.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38672025-01-22T05:18:52.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38682025-01-22T05:18:52.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38692025-01-22T05:18:52.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38702025-01-22T05:18:52.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38712025-01-22T05:18:52.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38722025-01-22T05:18:52.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
38732025-01-22T05:18:52.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38742025-01-22T05:18:52.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38752025-01-22T05:18:52.843ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
38762025-01-22T05:18:52.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.528808ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
38772025-01-22T05:18:52.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.747216ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38782025-01-22T05:18:52.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0fa220d9-cf6a-4c98-bab9-6f7ad2c4242e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38792025-01-22T05:18:52.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0fa220d9-cf6a-4c98-bab9-6f7ad2c4242e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38802025-01-22T05:18:52.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0fa220d9-cf6a-4c98-bab9-6f7ad2c4242e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38812025-01-22T05:18:54.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bb1fad3c-4756-4e21-8a34-d810599a4781 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38822025-01-22T05:18:54.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bb1fad3c-4756-4e21-8a34-d810599a4781 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38832025-01-22T05:18:54.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bb1fad3c-4756-4e21-8a34-d810599a4781 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38842025-01-22T05:18:55.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0ae938ce-9d86-4d82-b6f2-e34b1d61cdb2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38852025-01-22T05:18:55.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0ae938ce-9d86-4d82-b6f2-e34b1d61cdb2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38862025-01-22T05:18:55.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0ae938ce-9d86-4d82-b6f2-e34b1d61cdb2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38872025-01-22T05:18:55.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 784 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = fb5c37db-098f-471b-9f62-27f2323d363f response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
38882025-01-22T05:18:56.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c73187cf-b725-4bcb-a087-91701666095e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38892025-01-22T05:18:56.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c73187cf-b725-4bcb-a087-91701666095e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38902025-01-22T05:18:56.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c73187cf-b725-4bcb-a087-91701666095e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38912025-01-22T05:18:57.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 40d532de-2501-49e6-adef-531433174abc roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38922025-01-22T05:18:57.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 40d532de-2501-49e6-adef-531433174abc resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38932025-01-22T05:18:57.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 40d532de-2501-49e6-adef-531433174abc response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38942025-01-22T05:18:58.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 37cff046-5042-46da-a4ed-5f9ce5897d74 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38952025-01-22T05:18:58.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 37cff046-5042-46da-a4ed-5f9ce5897d74 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38962025-01-22T05:18:58.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 37cff046-5042-46da-a4ed-5f9ce5897d74 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38972025-01-22T05:18:59.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7dfdfb39-d5af-43e7-a16b-f90413f28b9f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38982025-01-22T05:18:59.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7dfdfb39-d5af-43e7-a16b-f90413f28b9f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
38992025-01-22T05:18:59.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7dfdfb39-d5af-43e7-a16b-f90413f28b9f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39002025-01-22T05:19:00.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d76c6a45-0521-46be-8ba8-de2d3b936660 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39012025-01-22T05:19:00.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d76c6a45-0521-46be-8ba8-de2d3b936660 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39022025-01-22T05:19:00.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d76c6a45-0521-46be-8ba8-de2d3b936660 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39032025-01-22T05:19:00.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 74efac7c-daad-4b6d-be77-dcf8943d4ebd roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
39042025-01-22T05:19:00.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 74efac7c-daad-4b6d-be77-dcf8943d4ebd resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
39052025-01-22T05:19:00.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 74efac7c-daad-4b6d-be77-dcf8943d4ebd response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
39062025-01-22T05:19:00.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 622b73b6-c633-4397-851e-35031a24ba28 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
39072025-01-22T05:19:00.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 622b73b6-c633-4397-851e-35031a24ba28 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
39082025-01-22T05:19:00.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41342 req_id = 622b73b6-c633-4397-851e-35031a24ba28 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
39092025-01-22T05:19:01.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1703ee22-76a4-457e-b1d9-d8a76b59df23 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39102025-01-22T05:19:01.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1703ee22-76a4-457e-b1d9-d8a76b59df23 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39112025-01-22T05:19:01.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1703ee22-76a4-457e-b1d9-d8a76b59df23 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39122025-01-22T05:19:02.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3a021941-3b07-4c39-95fb-bd6b2ab66388 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39132025-01-22T05:19:02.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3a021941-3b07-4c39-95fb-bd6b2ab66388 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39142025-01-22T05:19:02.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3a021941-3b07-4c39-95fb-bd6b2ab66388 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
39152025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
39162025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
39172025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39182025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
39192025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
39202025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
39212025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39222025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39232025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
39242025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39252025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39262025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
39272025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39282025-01-22T05:19:02.822ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
39292025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39302025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
39312025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39322025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
39332025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39342025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39352025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39362025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
39372025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
39382025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39392025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39402025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39412025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39422025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
39432025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
39442025-01-22T05:19:02.823ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39452025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39462025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39472025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39482025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39492025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39502025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39512025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39522025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39532025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39542025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39552025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39562025-01-22T05:19:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39572025-01-22T05:19:02.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39582025-01-22T05:19:02.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39592025-01-22T05:19:02.826ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.244196ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39602025-01-22T05:19:02.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39612025-01-22T05:19:02.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39622025-01-22T05:19:02.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39632025-01-22T05:19:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39642025-01-22T05:19:02.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39652025-01-22T05:19:02.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39662025-01-22T05:19:02.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11325, tv_nsec: 178875619 } })
39672025-01-22T05:19:02.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
39682025-01-22T05:19:02.831ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39692025-01-22T05:19:02.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11325, tv_nsec: 179978891 } })
39702025-01-22T05:19:02.832ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
39712025-01-22T05:19:02.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39722025-01-22T05:19:02.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39732025-01-22T05:19:02.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39742025-01-22T05:19:02.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39752025-01-22T05:19:02.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39762025-01-22T05:19:02.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39772025-01-22T05:19:02.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39782025-01-22T05:19:02.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39792025-01-22T05:19:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39802025-01-22T05:19:02.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39812025-01-22T05:19:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39822025-01-22T05:19:02.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39832025-01-22T05:19:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39842025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
39852025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
39862025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39872025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39882025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
39892025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39902025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
39912025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39922025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39932025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39942025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39952025-01-22T05:19:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39962025-01-22T05:19:02.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39972025-01-22T05:19:02.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39982025-01-22T05:19:02.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39992025-01-22T05:19:02.871ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40002025-01-22T05:19:02.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40012025-01-22T05:19:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40022025-01-22T05:19:02.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40032025-01-22T05:19:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40042025-01-22T05:19:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40052025-01-22T05:19:02.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40062025-01-22T05:19:02.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40072025-01-22T05:19:02.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40082025-01-22T05:19:02.875ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40092025-01-22T05:19:02.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40102025-01-22T05:19:02.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40112025-01-22T05:19:02.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40122025-01-22T05:19:02.878ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40132025-01-22T05:19:02.878ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40142025-01-22T05:19:02.878ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40152025-01-22T05:19:02.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40162025-01-22T05:19:02.878ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11325, tv_nsec: 226711283 } })
40172025-01-22T05:19:02.878ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
40182025-01-22T05:19:02.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40192025-01-22T05:19:02.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40202025-01-22T05:19:02.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40212025-01-22T05:19:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40222025-01-22T05:19:02.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40232025-01-22T05:19:02.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40242025-01-22T05:19:02.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40252025-01-22T05:19:02.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40262025-01-22T05:19:02.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40272025-01-22T05:19:02.887ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40282025-01-22T05:19:02.887ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.587086ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40292025-01-22T05:19:02.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40302025-01-22T05:19:02.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40312025-01-22T05:19:02.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40322025-01-22T05:19:02.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40332025-01-22T05:19:02.889ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40342025-01-22T05:19:02.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40352025-01-22T05:19:02.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 47.226582ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40362025-01-22T05:19:02.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.811614ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
40372025-01-22T05:19:02.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
40382025-01-22T05:19:02.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40392025-01-22T05:19:02.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40402025-01-22T05:19:02.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.881984ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40412025-01-22T05:19:02.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.573503ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
40422025-01-22T05:19:02.915ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
40432025-01-22T05:19:02.915ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40442025-01-22T05:19:02.915ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "79f31afe-92a3-4c3b-a686-54fd5e06a842", "content-length": "26", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
40452025-01-22T05:19:02.915ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40462025-01-22T05:19:02.915ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
40472025-01-22T05:19:02.915ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.100507ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
40482025-01-22T05:19:02.917ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40492025-01-22T05:19:02.917ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40502025-01-22T05:19:02.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40512025-01-22T05:19:02.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40522025-01-22T05:19:02.922ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40532025-01-22T05:19:02.922ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40542025-01-22T05:19:02.922ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40552025-01-22T05:19:02.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40562025-01-22T05:19:02.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40572025-01-22T05:19:02.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40582025-01-22T05:19:02.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40592025-01-22T05:19:02.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40602025-01-22T05:19:02.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
40612025-01-22T05:19:02.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40622025-01-22T05:19:02.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40632025-01-22T05:19:02.930ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40642025-01-22T05:19:02.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40652025-01-22T05:19:02.932ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.401229ms iteration = 18 status = 0
40662025-01-22T05:19:02.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.748186ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40672025-01-22T05:19:02.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
40682025-01-22T05:19:02.937ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40692025-01-22T05:19:02.937ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "278e3f6d-538f-4151-8f8a-91a7676ba1d6", "content-length": "26", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
40702025-01-22T05:19:02.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40712025-01-22T05:19:02.939ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40722025-01-22T05:19:02.958ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732025-01-22T05:19:02.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40742025-01-22T05:19:02.960ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40752025-01-22T05:19:02.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40762025-01-22T05:19:02.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 117.763399ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
40772025-01-22T05:19:02.962ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
40782025-01-22T05:19:02.962ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 139.441821ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
40792025-01-22T05:19:02.963ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40802025-01-22T05:19:02.963ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40812025-01-22T05:19:02.963ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.533953ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40822025-01-22T05:19:02.968ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
40832025-01-22T05:19:02.968ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40842025-01-22T05:19:02.968ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d2ad4c4-8fe4-4512-96bd-6c5539901192", "content-length": "26", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
40852025-01-22T05:19:02.968ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40862025-01-22T05:19:02.971ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
40872025-01-22T05:19:03.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40882025-01-22T05:19:03.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40892025-01-22T05:19:03.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40902025-01-22T05:19:03.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40912025-01-22T05:19:03.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40922025-01-22T05:19:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40932025-01-22T05:19:03.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40942025-01-22T05:19:03.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40952025-01-22T05:19:03.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40962025-01-22T05:19:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40972025-01-22T05:19:03.022ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 199.859741ms iteration = 20 status = {"physical_disks_added":0}
40982025-01-22T05:19:03.027ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 204.293382ms iteration = 18 status = {}
40992025-01-22T05:19:03.043ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41002025-01-22T05:19:03.044ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f151597b-d8bd-4670-afc8-e2b247c74e11", "content-length": "1", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41012025-01-22T05:19:03.046ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41022025-01-22T05:19:03.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41032025-01-22T05:19:03.128ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41042025-01-22T05:19:03.128ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41052025-01-22T05:19:03.129ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc7e563c-ba5b-42d2-884f-f421c433709f", "content-length": "372", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41062025-01-22T05:19:03.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41072025-01-22T05:19:03.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41082025-01-22T05:19:03.131ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 308.30847ms iteration = 18 status = null
41092025-01-22T05:19:03.174ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41102025-01-22T05:19:03.174ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41112025-01-22T05:19:03.174ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "479dd2fc-a5ff-4d07-9653-8b8b9991d6f1", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41122025-01-22T05:19:03.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41132025-01-22T05:19:03.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41142025-01-22T05:19:03.176ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41152025-01-22T05:19:03.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41162025-01-22T05:19:03.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41172025-01-22T05:19:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41182025-01-22T05:19:03.182ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41192025-01-22T05:19:03.182ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41202025-01-22T05:19:03.183ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cde67ac7-ad41-4b67-9d7b-963122b1a7ca", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41212025-01-22T05:19:03.184ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 361.107716ms iteration = 18 status = {}
41222025-01-22T05:19:03.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41232025-01-22T05:19:03.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41242025-01-22T05:19:03.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f87809cb-d8b0-4845-bb0b-2cb3bf2b80e8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41252025-01-22T05:19:03.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f87809cb-d8b0-4845-bb0b-2cb3bf2b80e8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41262025-01-22T05:19:03.221ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41272025-01-22T05:19:03.222ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea96187e-08a3-48e1-984d-42cdd74559cc", "content-length": "691", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41282025-01-22T05:19:03.222ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41292025-01-22T05:19:03.222ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41302025-01-22T05:19:03.222ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41312025-01-22T05:19:03.223ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
41322025-01-22T05:19:03.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41332025-01-22T05:19:03.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41342025-01-22T05:19:03.223ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 400.57122ms iteration = 18 status = {}
41352025-01-22T05:19:03.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 11934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f87809cb-d8b0-4845-bb0b-2cb3bf2b80e8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41362025-01-22T05:19:03.232ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41372025-01-22T05:19:03.232ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6b8c5c6-bd2b-450b-8c30-7a5c09e0fada", "content-length": "134", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41382025-01-22T05:19:03.232ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41392025-01-22T05:19:03.232ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
41402025-01-22T05:19:03.232ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41412025-01-22T05:19:03.232ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41422025-01-22T05:19:03.232ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41432025-01-22T05:19:03.233ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41442025-01-22T05:19:03.233ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41452025-01-22T05:19:03.233ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41462025-01-22T05:19:03.233ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41472025-01-22T05:19:03.233ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41482025-01-22T05:19:03.233ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
41492025-01-22T05:19:03.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41502025-01-22T05:19:03.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41512025-01-22T05:19:03.234ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41522025-01-22T05:19:03.234ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "49b03876-5c04-4847-89dc-b6116334b76d", "content-length": "2", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41532025-01-22T05:19:03.234ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41542025-01-22T05:19:03.235ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "39658da2-efde-4938-9852-57853864851f", "content-length": "51", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41552025-01-22T05:19:03.235ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
41562025-01-22T05:19:03.235ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41572025-01-22T05:19:03.326ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "16d6ae32-19e1-4778-a2a8-1e2ac38357b8", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41582025-01-22T05:19:03.326ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
41592025-01-22T05:19:03.326ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41602025-01-22T05:19:03.327ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6554b7f-4bf1-4ff5-a972-e1c6715534dc", "content-length": "682", "date": "Wed, 22 Jan 2025 05:19:02 GMT"} })
41612025-01-22T05:19:03.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41622025-01-22T05:19:03.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41632025-01-22T05:19:03.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41642025-01-22T05:19:03.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41652025-01-22T05:19:03.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41662025-01-22T05:19:03.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41672025-01-22T05:19:03.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41682025-01-22T05:19:03.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41692025-01-22T05:19:03.343ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 520.825969ms iteration = 18 status = {}
41702025-01-22T05:19:03.801ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
41712025-01-22T05:19:03.801ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
41722025-01-22T05:19:03.831ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
41732025-01-22T05:19:03.831ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:45139
41742025-01-22T05:19:03.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45139 req_id = 7c5f9485-6e54-4839-a147-5860d8eec18c roles = RoleSet { roles: {} } uri = /metrics/producers
41752025-01-22T05:19:03.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45139 req_id = 7c5f9485-6e54-4839-a147-5860d8eec18c resource = Database result = Ok(()) uri = /metrics/producers
41762025-01-22T05:19:03.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 888a66e2-db42-4496-a442-efb7d5de6c88 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41772025-01-22T05:19:03.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 888a66e2-db42-4496-a442-efb7d5de6c88 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41782025-01-22T05:19:03.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 888a66e2-db42-4496-a442-efb7d5de6c88 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41792025-01-22T05:19:03.869ZINFOnexus: assigned collector to new producer collector_id = 95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0 file = nexus/src/app/oximeter.rs:76 producer_id = 3fbe3917-aca1-4b36-8119-948b03a24746
41802025-01-22T05:19:03.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38199 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45139 req_id = 7c5f9485-6e54-4839-a147-5860d8eec18c response_code = 201 uri = /metrics/producers
41812025-01-22T05:19:03.869ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "7c5f9485-6e54-4839-a147-5860d8eec18c", "content-length": "41", "date": "Wed, 22 Jan 2025 05:19:03 GMT"} })
41822025-01-22T05:19:03.871ZDEBGnexus (producer-registration-task): registered with nexus successfully
41832025-01-22T05:19:03.871ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
41842025-01-22T05:19:04.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ec2e68f-fdf2-4f3a-8f36-91fa735e6213 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41852025-01-22T05:19:04.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ec2e68f-fdf2-4f3a-8f36-91fa735e6213 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41862025-01-22T05:19:04.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ec2e68f-fdf2-4f3a-8f36-91fa735e6213 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41872025-01-22T05:19:05.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f2527020-4e24-436a-9987-5efe1dc28146 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41882025-01-22T05:19:05.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f2527020-4e24-436a-9987-5efe1dc28146 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41892025-01-22T05:19:05.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f2527020-4e24-436a-9987-5efe1dc28146 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41902025-01-22T05:19:05.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 842 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 76c0391e-8cab-4bc1-a30e-d19cab8fd99d response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
41912025-01-22T05:19:06.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f58414eb-af96-4d61-a089-65634004d36d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41922025-01-22T05:19:06.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f58414eb-af96-4d61-a089-65634004d36d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41932025-01-22T05:19:06.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f58414eb-af96-4d61-a089-65634004d36d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41942025-01-22T05:19:07.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eefcede9-57f6-4924-81af-fff7a0f92708 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41952025-01-22T05:19:07.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eefcede9-57f6-4924-81af-fff7a0f92708 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41962025-01-22T05:19:07.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eefcede9-57f6-4924-81af-fff7a0f92708 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41972025-01-22T05:19:08.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1e93b7f0-54d8-47d6-80b1-b2ce64ab3429 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41982025-01-22T05:19:08.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1e93b7f0-54d8-47d6-80b1-b2ce64ab3429 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
41992025-01-22T05:19:08.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1e93b7f0-54d8-47d6-80b1-b2ce64ab3429 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42002025-01-22T05:19:09.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2e3085f8-6fcd-42c1-92ef-9ff5819954c9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42012025-01-22T05:19:09.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2e3085f8-6fcd-42c1-92ef-9ff5819954c9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42022025-01-22T05:19:09.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2e3085f8-6fcd-42c1-92ef-9ff5819954c9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42032025-01-22T05:19:10.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7bf9efb2-f510-432c-94d2-60d382836d3c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42042025-01-22T05:19:10.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7bf9efb2-f510-432c-94d2-60d382836d3c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42052025-01-22T05:19:10.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7bf9efb2-f510-432c-94d2-60d382836d3c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42062025-01-22T05:19:11.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 809c7091-081a-4a24-b650-ff646aad1cac roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42072025-01-22T05:19:11.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 809c7091-081a-4a24-b650-ff646aad1cac resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42082025-01-22T05:19:11.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 809c7091-081a-4a24-b650-ff646aad1cac response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42092025-01-22T05:19:12.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 35e19c10-e219-4989-ab63-d57a17074c87 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42102025-01-22T05:19:12.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 35e19c10-e219-4989-ab63-d57a17074c87 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42112025-01-22T05:19:12.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 35e19c10-e219-4989-ab63-d57a17074c87 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42122025-01-22T05:19:12.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
42132025-01-22T05:19:12.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42142025-01-22T05:19:12.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42152025-01-22T05:19:12.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42162025-01-22T05:19:12.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
42172025-01-22T05:19:12.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42182025-01-22T05:19:12.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42192025-01-22T05:19:12.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42202025-01-22T05:19:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42212025-01-22T05:19:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42222025-01-22T05:19:12.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42232025-01-22T05:19:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42242025-01-22T05:19:12.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42252025-01-22T05:19:12.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42262025-01-22T05:19:12.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42272025-01-22T05:19:12.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
42282025-01-22T05:19:12.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42292025-01-22T05:19:12.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42302025-01-22T05:19:12.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
42312025-01-22T05:19:12.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.13188ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
42322025-01-22T05:19:12.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.549153ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42332025-01-22T05:19:13.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2177b0d3-fee4-4164-a2c3-44ada2b00c7a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42342025-01-22T05:19:13.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2177b0d3-fee4-4164-a2c3-44ada2b00c7a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42352025-01-22T05:19:13.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2177b0d3-fee4-4164-a2c3-44ada2b00c7a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42362025-01-22T05:19:14.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 32017dac-0acc-4492-b97c-0afcf03544be roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42372025-01-22T05:19:14.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 32017dac-0acc-4492-b97c-0afcf03544be resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42382025-01-22T05:19:14.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 32017dac-0acc-4492-b97c-0afcf03544be response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42392025-01-22T05:19:15.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = da6d3682-f60e-43ce-abd4-38213c86284f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42402025-01-22T05:19:15.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = da6d3682-f60e-43ce-abd4-38213c86284f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42412025-01-22T05:19:15.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = da6d3682-f60e-43ce-abd4-38213c86284f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42422025-01-22T05:19:15.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 522 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 91ce091e-7600-48b1-bed2-538677971256 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
42432025-01-22T05:19:16.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5a12774a-6b6a-41d8-bf09-030a45ee5344 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42442025-01-22T05:19:16.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5a12774a-6b6a-41d8-bf09-030a45ee5344 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42452025-01-22T05:19:16.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5a12774a-6b6a-41d8-bf09-030a45ee5344 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42462025-01-22T05:19:17.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ed404a1-6ff7-45d5-8162-9acc00bb0b2a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42472025-01-22T05:19:17.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ed404a1-6ff7-45d5-8162-9acc00bb0b2a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42482025-01-22T05:19:17.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ed404a1-6ff7-45d5-8162-9acc00bb0b2a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42492025-01-22T05:19:18.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3137e561-73f4-4fdb-9c2f-7f045498af5b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42502025-01-22T05:19:18.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3137e561-73f4-4fdb-9c2f-7f045498af5b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42512025-01-22T05:19:18.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3137e561-73f4-4fdb-9c2f-7f045498af5b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42522025-01-22T05:19:19.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 395dc1c8-3226-4954-b32c-960785bdc1b4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42532025-01-22T05:19:19.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 395dc1c8-3226-4954-b32c-960785bdc1b4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42542025-01-22T05:19:19.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 395dc1c8-3226-4954-b32c-960785bdc1b4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42552025-01-22T05:19:20.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dd0fdd2e-0bbc-45c6-bee5-97ec1890048b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42562025-01-22T05:19:20.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dd0fdd2e-0bbc-45c6-bee5-97ec1890048b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42572025-01-22T05:19:20.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dd0fdd2e-0bbc-45c6-bee5-97ec1890048b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42582025-01-22T05:19:21.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b26bb862-375f-4fff-a266-559fb8f6de89 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42592025-01-22T05:19:21.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b26bb862-375f-4fff-a266-559fb8f6de89 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42602025-01-22T05:19:21.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b26bb862-375f-4fff-a266-559fb8f6de89 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42612025-01-22T05:19:22.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e4c19fdf-8fb2-4f2f-b0c2-86fe2d77bdaa roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42622025-01-22T05:19:22.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e4c19fdf-8fb2-4f2f-b0c2-86fe2d77bdaa resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42632025-01-22T05:19:22.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e4c19fdf-8fb2-4f2f-b0c2-86fe2d77bdaa response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42642025-01-22T05:19:22.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
42652025-01-22T05:19:22.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42662025-01-22T05:19:22.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42672025-01-22T05:19:22.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
42682025-01-22T05:19:22.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42692025-01-22T05:19:22.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42702025-01-22T05:19:22.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42712025-01-22T05:19:22.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42722025-01-22T05:19:22.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42732025-01-22T05:19:22.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.601864ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42742025-01-22T05:19:22.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42752025-01-22T05:19:22.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42762025-01-22T05:19:22.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42772025-01-22T05:19:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42782025-01-22T05:19:22.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42792025-01-22T05:19:22.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42802025-01-22T05:19:22.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
42812025-01-22T05:19:22.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42822025-01-22T05:19:22.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42832025-01-22T05:19:22.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
42842025-01-22T05:19:22.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.841045ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
42852025-01-22T05:19:23.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5c2b021d-2887-4b79-816a-c3c02d2de7d4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42862025-01-22T05:19:23.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5c2b021d-2887-4b79-816a-c3c02d2de7d4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42872025-01-22T05:19:23.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5c2b021d-2887-4b79-816a-c3c02d2de7d4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42882025-01-22T05:19:24.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5eca6595-c527-4021-834a-66aafaf44382 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42892025-01-22T05:19:24.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5eca6595-c527-4021-834a-66aafaf44382 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42902025-01-22T05:19:24.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5eca6595-c527-4021-834a-66aafaf44382 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42912025-01-22T05:19:25.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c83caab-8aba-47a7-8bd2-876997f0a91e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42922025-01-22T05:19:25.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c83caab-8aba-47a7-8bd2-876997f0a91e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42932025-01-22T05:19:25.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c83caab-8aba-47a7-8bd2-876997f0a91e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42942025-01-22T05:19:25.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 565 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 8ae96f9d-0063-4bbb-bc55-bf3b056b62c3 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
42952025-01-22T05:19:26.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 04569cc0-5f8e-4e9e-b2d7-91f447b9dff4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42962025-01-22T05:19:26.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 04569cc0-5f8e-4e9e-b2d7-91f447b9dff4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42972025-01-22T05:19:26.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 04569cc0-5f8e-4e9e-b2d7-91f447b9dff4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42982025-01-22T05:19:27.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a21218c3-4642-4faf-bada-d3260ade62b8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
42992025-01-22T05:19:27.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a21218c3-4642-4faf-bada-d3260ade62b8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43002025-01-22T05:19:27.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a21218c3-4642-4faf-bada-d3260ade62b8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43012025-01-22T05:19:28.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 097bc8aa-fdce-439d-bfe8-181223b56797 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43022025-01-22T05:19:28.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 097bc8aa-fdce-439d-bfe8-181223b56797 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43032025-01-22T05:19:28.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 097bc8aa-fdce-439d-bfe8-181223b56797 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43042025-01-22T05:19:29.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3594af59-934b-4584-b7a2-b8fadeb9d1b0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43052025-01-22T05:19:29.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3594af59-934b-4584-b7a2-b8fadeb9d1b0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43062025-01-22T05:19:29.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3594af59-934b-4584-b7a2-b8fadeb9d1b0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43072025-01-22T05:19:30.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a6a516c-2b1c-4b85-bce5-42ae9e70f484 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43082025-01-22T05:19:30.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a6a516c-2b1c-4b85-bce5-42ae9e70f484 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43092025-01-22T05:19:30.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a6a516c-2b1c-4b85-bce5-42ae9e70f484 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43102025-01-22T05:19:31.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8cf5b7f5-cadb-45e3-bb17-794ad6e49298 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43112025-01-22T05:19:31.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8cf5b7f5-cadb-45e3-bb17-794ad6e49298 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43122025-01-22T05:19:31.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8cf5b7f5-cadb-45e3-bb17-794ad6e49298 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
43132025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
43142025-01-22T05:19:32.822ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
43152025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
43162025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43172025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
43182025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43192025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
43202025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
43212025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
43222025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43232025-01-22T05:19:32.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
43242025-01-22T05:19:32.822ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
43252025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
43262025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
43272025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.161\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
43282025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
43292025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43302025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43312025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
43322025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43332025-01-22T05:19:32.823ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:09:32.822908295 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
43342025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
43352025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
43362025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
43372025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43382025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
43392025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
43402025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43412025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
43422025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43432025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
43442025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43452025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
43462025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43472025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
43482025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43492025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
43502025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43512025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
43522025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
43532025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
43542025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43552025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43562025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43572025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43582025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43592025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43602025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43612025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43622025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43632025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
43642025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
43652025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
43662025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43672025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43682025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
43692025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
43702025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43712025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43722025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43732025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
43742025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43752025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
43762025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43772025-01-22T05:19:32.823ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43782025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43792025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43802025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43812025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43822025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43832025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43842025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43852025-01-22T05:19:32.823ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11355, tv_nsec: 171741343 } })
43862025-01-22T05:19:32.823ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11355, tv_nsec: 171742023 } })
43872025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43882025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43892025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43902025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43912025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43922025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43932025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43942025-01-22T05:19:32.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43952025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43962025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43972025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
43982025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
43992025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.222645ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
44002025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.097032ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
44012025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44022025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44032025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44042025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44052025-01-22T05:19:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44062025-01-22T05:19:32.826ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.335418ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44072025-01-22T05:19:32.826ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082025-01-22T05:19:32.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44092025-01-22T05:19:32.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44102025-01-22T05:19:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44112025-01-22T05:19:32.827ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:09:32.822908295 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44122025-01-22T05:19:32.827ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.833009ms iteration = 10 status = {"expiration":"2025-01-22T05:09:32.822908295Z","pruned":[]}
44132025-01-22T05:19:32.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44142025-01-22T05:19:32.828ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44152025-01-22T05:19:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44162025-01-22T05:19:32.828ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44172025-01-22T05:19:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44182025-01-22T05:19:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44192025-01-22T05:19:32.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11355, tv_nsec: 179160854 } })
44202025-01-22T05:19:32.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44212025-01-22T05:19:32.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11355, tv_nsec: 179344348 } })
44222025-01-22T05:19:32.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
44232025-01-22T05:19:32.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
44242025-01-22T05:19:32.831ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44252025-01-22T05:19:32.832ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262025-01-22T05:19:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44272025-01-22T05:19:32.834ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44282025-01-22T05:19:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44292025-01-22T05:19:32.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44302025-01-22T05:19:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44312025-01-22T05:19:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44322025-01-22T05:19:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44332025-01-22T05:19:32.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44342025-01-22T05:19:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44352025-01-22T05:19:32.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362025-01-22T05:19:32.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44372025-01-22T05:19:32.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44382025-01-22T05:19:32.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44392025-01-22T05:19:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44402025-01-22T05:19:32.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44412025-01-22T05:19:32.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44422025-01-22T05:19:32.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44432025-01-22T05:19:32.843ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44442025-01-22T05:19:32.843ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44452025-01-22T05:19:32.843ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.194262ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44462025-01-22T05:19:32.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
44472025-01-22T05:19:32.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44482025-01-22T05:19:32.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
44492025-01-22T05:19:32.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44502025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
44512025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44522025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
44532025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44542025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
44552025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
44562025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44572025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44582025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44592025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44602025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44612025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
44622025-01-22T05:19:32.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44632025-01-22T05:19:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44642025-01-22T05:19:32.847ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44652025-01-22T05:19:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44662025-01-22T05:19:32.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44672025-01-22T05:19:32.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44682025-01-22T05:19:32.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44692025-01-22T05:19:32.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44702025-01-22T05:19:32.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44712025-01-22T05:19:32.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44722025-01-22T05:19:32.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44732025-01-22T05:19:32.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44742025-01-22T05:19:32.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44752025-01-22T05:19:32.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44762025-01-22T05:19:32.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44772025-01-22T05:19:32.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44782025-01-22T05:19:32.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44792025-01-22T05:19:32.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44802025-01-22T05:19:32.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44812025-01-22T05:19:32.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44822025-01-22T05:19:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44832025-01-22T05:19:32.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44842025-01-22T05:19:32.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44852025-01-22T05:19:32.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44862025-01-22T05:19:32.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.157859ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
44872025-01-22T05:19:32.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44882025-01-22T05:19:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44892025-01-22T05:19:32.887ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44902025-01-22T05:19:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44912025-01-22T05:19:32.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44922025-01-22T05:19:32.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44932025-01-22T05:19:32.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44942025-01-22T05:19:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44952025-01-22T05:19:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44962025-01-22T05:19:32.890ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44972025-01-22T05:19:32.890ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44982025-01-22T05:19:32.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44992025-01-22T05:19:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45002025-01-22T05:19:32.890ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 45.766712ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
45012025-01-22T05:19:32.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45022025-01-22T05:19:32.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45032025-01-22T05:19:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45042025-01-22T05:19:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45052025-01-22T05:19:32.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45062025-01-22T05:19:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45072025-01-22T05:19:32.894ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11355, tv_nsec: 242863782 } })
45082025-01-22T05:19:32.895ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
45092025-01-22T05:19:32.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45102025-01-22T05:19:32.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45112025-01-22T05:19:32.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45122025-01-22T05:19:32.899ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45132025-01-22T05:19:32.899ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
45142025-01-22T05:19:32.899ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.544839ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45152025-01-22T05:19:32.899ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45162025-01-22T05:19:32.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45172025-01-22T05:19:32.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45182025-01-22T05:19:32.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45192025-01-22T05:19:32.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45202025-01-22T05:19:32.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45212025-01-22T05:19:32.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45222025-01-22T05:19:32.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45232025-01-22T05:19:32.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45242025-01-22T05:19:32.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45252025-01-22T05:19:32.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45262025-01-22T05:19:32.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272025-01-22T05:19:32.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45282025-01-22T05:19:32.910ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45292025-01-22T05:19:32.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45302025-01-22T05:19:32.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
45312025-01-22T05:19:32.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45322025-01-22T05:19:32.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45332025-01-22T05:19:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
45342025-01-22T05:19:32.912ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45352025-01-22T05:19:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45362025-01-22T05:19:32.914ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
45372025-01-22T05:19:32.914ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
45382025-01-22T05:19:32.914ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
45392025-01-22T05:19:32.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45402025-01-22T05:19:32.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45412025-01-22T05:19:32.917ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45422025-01-22T05:19:32.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45432025-01-22T05:19:32.917ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 94.535176ms iteration = 5 status = {"nsuccess":5}
45442025-01-22T05:19:32.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452025-01-22T05:19:32.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.718963ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
45462025-01-22T05:19:32.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45472025-01-22T05:19:32.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45482025-01-22T05:19:32.923ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45492025-01-22T05:19:32.923ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.13256ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45502025-01-22T05:19:32.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45512025-01-22T05:19:32.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45522025-01-22T05:19:32.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45532025-01-22T05:19:32.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45542025-01-22T05:19:32.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45552025-01-22T05:19:32.933ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
45562025-01-22T05:19:32.933ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.106333ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
45572025-01-22T05:19:32.935ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45582025-01-22T05:19:32.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45592025-01-22T05:19:32.938ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45602025-01-22T05:19:32.939ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45612025-01-22T05:19:32.939ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45622025-01-22T05:19:32.939ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45632025-01-22T05:19:32.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45642025-01-22T05:19:32.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45652025-01-22T05:19:32.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
45662025-01-22T05:19:32.940ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45672025-01-22T05:19:32.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45682025-01-22T05:19:32.942ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.678578ms iteration = 19 status = 0
45692025-01-22T05:19:32.942ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45702025-01-22T05:19:32.942ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45712025-01-22T05:19:32.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45722025-01-22T05:19:32.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45732025-01-22T05:19:32.944ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45742025-01-22T05:19:32.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45752025-01-22T05:19:32.946ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
45762025-01-22T05:19:32.946ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45772025-01-22T05:19:32.947ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "940b7b90-e3bd-4b4d-a9ee-6f2a65d9de80", "content-length": "26", "date": "Wed, 22 Jan 2025 05:19:32 GMT"} })
45782025-01-22T05:19:32.947ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45792025-01-22T05:19:32.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 123.635889ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45802025-01-22T05:19:32.948ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45812025-01-22T05:19:32.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 134.292036ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45822025-01-22T05:19:32.958ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45832025-01-22T05:19:32.958ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45842025-01-22T05:19:32.958ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45852025-01-22T05:19:32.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45862025-01-22T05:19:32.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45872025-01-22T05:19:32.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45882025-01-22T05:19:32.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45892025-01-22T05:19:32.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45902025-01-22T05:19:32.965ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
45912025-01-22T05:19:32.965ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45922025-01-22T05:19:32.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.325651ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
45932025-01-22T05:19:32.965ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea6e3b59-d5bb-483d-b8a2-78d58715dd6d", "content-length": "26", "date": "Wed, 22 Jan 2025 05:19:32 GMT"} })
45942025-01-22T05:19:32.965ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45952025-01-22T05:19:32.967ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45962025-01-22T05:19:32.970ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
45972025-01-22T05:19:32.970ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 147.123717ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
45982025-01-22T05:19:32.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45992025-01-22T05:19:32.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46002025-01-22T05:19:32.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46012025-01-22T05:19:32.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46022025-01-22T05:19:32.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46032025-01-22T05:19:32.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46042025-01-22T05:19:32.992ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
46052025-01-22T05:19:32.992ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
46062025-01-22T05:19:32.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46072025-01-22T05:19:32.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46082025-01-22T05:19:32.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 148.919584ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46092025-01-22T05:19:32.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46102025-01-22T05:19:32.994ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
46112025-01-22T05:19:32.994ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
46122025-01-22T05:19:32.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46132025-01-22T05:19:32.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46142025-01-22T05:19:32.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46152025-01-22T05:19:32.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46162025-01-22T05:19:32.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46172025-01-22T05:19:32.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46182025-01-22T05:19:33.002ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46192025-01-22T05:19:33.002ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46202025-01-22T05:19:33.002ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.17761ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46212025-01-22T05:19:33.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46222025-01-22T05:19:33.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46232025-01-22T05:19:33.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46242025-01-22T05:19:33.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46252025-01-22T05:19:33.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46262025-01-22T05:19:33.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46272025-01-22T05:19:33.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46282025-01-22T05:19:33.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a849b50f-30a4-4050-9804-fd01237b2f66 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
46292025-01-22T05:19:33.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a849b50f-30a4-4050-9804-fd01237b2f66 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
46302025-01-22T05:19:33.051ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
46312025-01-22T05:19:33.051ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 227.889963ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
46322025-01-22T05:19:33.061ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 238.351665ms iteration = 21 status = {"physical_disks_added":0}
46332025-01-22T05:19:33.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46342025-01-22T05:19:33.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46352025-01-22T05:19:33.098ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
46362025-01-22T05:19:33.098ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46372025-01-22T05:19:33.098ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cb35f8b-8ccf-4bd2-b347-1eb7bca1c7df", "content-length": "26", "date": "Wed, 22 Jan 2025 05:19:32 GMT"} })
46382025-01-22T05:19:33.098ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46392025-01-22T05:19:33.100ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
46402025-01-22T05:19:33.108ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
46412025-01-22T05:19:33.128ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46422025-01-22T05:19:33.129ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5786406e-da59-4c4d-b805-365eda2d7588", "content-length": "1", "date": "Wed, 22 Jan 2025 05:19:32 GMT"} })
46432025-01-22T05:19:33.130ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46442025-01-22T05:19:33.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46452025-01-22T05:19:33.205ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
46462025-01-22T05:19:33.205ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ef5e6ead-9ce2-4697-ab8e-259522409745", "date": "Wed, 22 Jan 2025 05:19:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46472025-01-22T05:19:33.205ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46482025-01-22T05:19:33.207ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46492025-01-22T05:19:33.207ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46502025-01-22T05:19:33.207ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "91d3f19c-7b7b-4f37-98c2-a55977c36e5a", "date": "Wed, 22 Jan 2025 05:19:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46512025-01-22T05:19:33.207ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46522025-01-22T05:19:33.207ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "35d76cc5-8acb-449f-82be-1e39c7cd891b", "content-length": "372", "date": "Wed, 22 Jan 2025 05:19:32 GMT"} })
46532025-01-22T05:19:33.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46542025-01-22T05:19:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46552025-01-22T05:19:33.209ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46562025-01-22T05:19:33.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 386.283199ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
46572025-01-22T05:19:33.209ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
46582025-01-22T05:19:33.209ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46592025-01-22T05:19:33.209ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
46602025-01-22T05:19:33.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 386.772879ms iteration = 10 status = {"generation":2}
46612025-01-22T05:19:33.209ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
46622025-01-22T05:19:33.209ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
46632025-01-22T05:19:33.209ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
46642025-01-22T05:19:33.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 386.977563ms iteration = 10 status = {"generation":1}
46652025-01-22T05:19:33.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a849b50f-30a4-4050-9804-fd01237b2f66 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
46662025-01-22T05:19:33.211ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46672025-01-22T05:19:33.211ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 388.425022ms iteration = 19 status = null
46682025-01-22T05:19:33.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46692025-01-22T05:19:33.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46702025-01-22T05:19:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46712025-01-22T05:19:33.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46722025-01-22T05:19:33.216ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46732025-01-22T05:19:33.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46742025-01-22T05:19:33.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46752025-01-22T05:19:33.224ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 401.860186ms iteration = 19 status = {}
46762025-01-22T05:19:33.243ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
46772025-01-22T05:19:33.243ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 420.22684ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46782025-01-22T05:19:33.248ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
46792025-01-22T05:19:33.248ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4a3f8ed0-bf2f-42af-9d03-55303c213883", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46802025-01-22T05:19:33.248ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46812025-01-22T05:19:33.250ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "71f8058e-76e2-47ea-9630-88f605411e2a", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46822025-01-22T05:19:33.250ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46832025-01-22T05:19:33.251ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "58dcab74-54c3-4340-aef3-2a25dd9bdf7d", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46842025-01-22T05:19:33.251ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46852025-01-22T05:19:33.253ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46862025-01-22T05:19:33.253ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46872025-01-22T05:19:33.253ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46882025-01-22T05:19:33.253ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 430.54542ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46892025-01-22T05:19:33.294ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46902025-01-22T05:19:33.315ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3ed4674-dc84-49d4-9706-7310786ea15e", "content-length": "691", "date": "Wed, 22 Jan 2025 05:19:32 GMT"} })
46912025-01-22T05:19:33.315ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46922025-01-22T05:19:33.315ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46932025-01-22T05:19:33.315ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46942025-01-22T05:19:33.315ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "29afd9bf-c632-411c-adba-478ebfaae299", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} })
46952025-01-22T05:19:33.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46962025-01-22T05:19:33.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46972025-01-22T05:19:33.316ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.704417ms iteration = 19 status = {}
46982025-01-22T05:19:33.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46992025-01-22T05:19:33.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47002025-01-22T05:19:33.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47012025-01-22T05:19:33.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47022025-01-22T05:19:33.324ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47032025-01-22T05:19:33.324ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47042025-01-22T05:19:33.325ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9c2cd281-83f2-4d9b-a459-ef99a5e3267f", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} })
47052025-01-22T05:19:33.327ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 503.602899ms iteration = 19 status = {}
47062025-01-22T05:19:33.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47072025-01-22T05:19:33.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47082025-01-22T05:19:33.333ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
47092025-01-22T05:19:33.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47102025-01-22T05:19:33.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47112025-01-22T05:19:33.342ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47122025-01-22T05:19:33.342ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6adabb73-1734-41ba-ab58-f196e08a2977", "content-length": "134", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} })
47132025-01-22T05:19:33.342ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47142025-01-22T05:19:33.342ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
47152025-01-22T05:19:33.343ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47162025-01-22T05:19:33.343ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47172025-01-22T05:19:33.343ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47182025-01-22T05:19:33.343ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47192025-01-22T05:19:33.343ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47202025-01-22T05:19:33.343ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47212025-01-22T05:19:33.343ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47222025-01-22T05:19:33.343ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47232025-01-22T05:19:33.343ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
47242025-01-22T05:19:33.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47252025-01-22T05:19:33.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47262025-01-22T05:19:33.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47272025-01-22T05:19:33.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "10e957a3-cb75-47d9-a6de-675ce81f7952", "content-length": "2", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} })
47282025-01-22T05:19:33.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47292025-01-22T05:19:33.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca9077b5-11ef-462f-b851-e9bf39a13e09", "content-length": "51", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} })
47302025-01-22T05:19:33.345ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
47312025-01-22T05:19:33.345ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47322025-01-22T05:19:33.438ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d75a2a69-9f57-4245-939f-9384fbee9725", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} })
47332025-01-22T05:19:33.438ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
47342025-01-22T05:19:33.438ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47352025-01-22T05:19:33.442ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8d7dd5e-9459-4e2f-9b58-9e33ce506101", "content-length": "682", "date": "Wed, 22 Jan 2025 05:19:33 GMT"} })
47362025-01-22T05:19:33.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47372025-01-22T05:19:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47382025-01-22T05:19:33.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47392025-01-22T05:19:33.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47402025-01-22T05:19:33.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47412025-01-22T05:19:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47422025-01-22T05:19:33.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47432025-01-22T05:19:33.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47442025-01-22T05:19:33.460ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 637.108227ms iteration = 19 status = {}
47452025-01-22T05:19:33.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = c43de49e-fb48-4896-8ed2-62bef9c067e4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
47462025-01-22T05:19:33.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = c43de49e-fb48-4896-8ed2-62bef9c067e4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
47472025-01-22T05:19:33.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = c43de49e-fb48-4896-8ed2-62bef9c067e4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
47482025-01-22T05:19:34.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3ad5aaa1-3d2e-4bc4-be48-7584e2edbd31 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47492025-01-22T05:19:34.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3ad5aaa1-3d2e-4bc4-be48-7584e2edbd31 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47502025-01-22T05:19:34.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3ad5aaa1-3d2e-4bc4-be48-7584e2edbd31 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47512025-01-22T05:19:35.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d71a11cb-1efe-499e-98b5-35f3b454c1f7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47522025-01-22T05:19:35.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d71a11cb-1efe-499e-98b5-35f3b454c1f7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47532025-01-22T05:19:35.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d71a11cb-1efe-499e-98b5-35f3b454c1f7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47542025-01-22T05:19:35.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 844 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = be2eb9d4-ae54-4096-bf60-807ea1ea58fa response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
47552025-01-22T05:19:36.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dbab5d67-5c92-448f-823d-16af78f3c1eb roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47562025-01-22T05:19:36.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dbab5d67-5c92-448f-823d-16af78f3c1eb resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47572025-01-22T05:19:36.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dbab5d67-5c92-448f-823d-16af78f3c1eb response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47582025-01-22T05:19:37.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 94f94c71-c954-44a8-9630-18c00ac01c44 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47592025-01-22T05:19:37.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 94f94c71-c954-44a8-9630-18c00ac01c44 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47602025-01-22T05:19:37.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 94f94c71-c954-44a8-9630-18c00ac01c44 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47612025-01-22T05:19:38.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 68011f05-a042-4a38-9f06-fe69bdbd61b2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47622025-01-22T05:19:38.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 68011f05-a042-4a38-9f06-fe69bdbd61b2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47632025-01-22T05:19:38.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 68011f05-a042-4a38-9f06-fe69bdbd61b2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47642025-01-22T05:19:39.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 904dbf90-fc18-47a2-837a-f49bc4e1821a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47652025-01-22T05:19:39.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 904dbf90-fc18-47a2-837a-f49bc4e1821a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47662025-01-22T05:19:39.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 904dbf90-fc18-47a2-837a-f49bc4e1821a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47672025-01-22T05:19:40.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f74fff83-0905-41ef-aad2-fcb7ea850322 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47682025-01-22T05:19:40.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f74fff83-0905-41ef-aad2-fcb7ea850322 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47692025-01-22T05:19:40.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f74fff83-0905-41ef-aad2-fcb7ea850322 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47702025-01-22T05:19:41.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 77fe9a7e-73d7-4f13-8036-7672199d74de roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47712025-01-22T05:19:41.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 77fe9a7e-73d7-4f13-8036-7672199d74de resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47722025-01-22T05:19:41.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 77fe9a7e-73d7-4f13-8036-7672199d74de response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47732025-01-22T05:19:42.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 42746050-ce57-4e95-85b8-6bc8d0ade1ed roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47742025-01-22T05:19:42.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 42746050-ce57-4e95-85b8-6bc8d0ade1ed resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47752025-01-22T05:19:42.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 42746050-ce57-4e95-85b8-6bc8d0ade1ed response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47762025-01-22T05:19:42.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
47772025-01-22T05:19:42.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47782025-01-22T05:19:42.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47792025-01-22T05:19:42.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
47802025-01-22T05:19:42.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47812025-01-22T05:19:42.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47822025-01-22T05:19:42.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47832025-01-22T05:19:42.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47842025-01-22T05:19:42.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47852025-01-22T05:19:42.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47862025-01-22T05:19:42.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47872025-01-22T05:19:42.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47882025-01-22T05:19:42.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47892025-01-22T05:19:42.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
47902025-01-22T05:19:42.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47912025-01-22T05:19:42.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47922025-01-22T05:19:42.846ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
47932025-01-22T05:19:42.846ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.923007ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
47942025-01-22T05:19:42.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47952025-01-22T05:19:42.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47962025-01-22T05:19:42.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.626244ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47972025-01-22T05:19:43.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bc105b5d-ab49-46ad-8982-ad300c2b21d2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47982025-01-22T05:19:43.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bc105b5d-ab49-46ad-8982-ad300c2b21d2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
47992025-01-22T05:19:43.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bc105b5d-ab49-46ad-8982-ad300c2b21d2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48002025-01-22T05:19:44.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 98369be0-0966-4e8b-82ff-6ee961b2a3fd roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48012025-01-22T05:19:44.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 98369be0-0966-4e8b-82ff-6ee961b2a3fd resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48022025-01-22T05:19:44.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 98369be0-0966-4e8b-82ff-6ee961b2a3fd response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48032025-01-22T05:19:45.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1e79ad5e-d9ff-4212-938e-c777ea1dcd5c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48042025-01-22T05:19:45.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1e79ad5e-d9ff-4212-938e-c777ea1dcd5c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48052025-01-22T05:19:45.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1e79ad5e-d9ff-4212-938e-c777ea1dcd5c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48062025-01-22T05:19:45.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 4441e489-c419-4bd3-a36d-876f6e5975bb response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
48072025-01-22T05:19:46.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 846d7b03-bb4f-41e2-b19d-36bf40c81ed1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48082025-01-22T05:19:46.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 846d7b03-bb4f-41e2-b19d-36bf40c81ed1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48092025-01-22T05:19:46.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 846d7b03-bb4f-41e2-b19d-36bf40c81ed1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48102025-01-22T05:19:47.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7114abe4-2603-4235-9ea6-a2edba225589 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48112025-01-22T05:19:47.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7114abe4-2603-4235-9ea6-a2edba225589 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48122025-01-22T05:19:47.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7114abe4-2603-4235-9ea6-a2edba225589 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48132025-01-22T05:19:48.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f1a8de2c-b478-4711-9855-9791ea09b37f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48142025-01-22T05:19:48.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f1a8de2c-b478-4711-9855-9791ea09b37f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48152025-01-22T05:19:48.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f1a8de2c-b478-4711-9855-9791ea09b37f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48162025-01-22T05:19:49.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2e66db9f-bb46-445d-950c-108aff271a9c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48172025-01-22T05:19:49.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2e66db9f-bb46-445d-950c-108aff271a9c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48182025-01-22T05:19:49.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2e66db9f-bb46-445d-950c-108aff271a9c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48192025-01-22T05:19:50.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e7c4d34e-d6ab-424f-8265-9f11ddd9e4c6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48202025-01-22T05:19:50.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e7c4d34e-d6ab-424f-8265-9f11ddd9e4c6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48212025-01-22T05:19:50.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e7c4d34e-d6ab-424f-8265-9f11ddd9e4c6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48222025-01-22T05:19:51.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d5587cbe-b8f8-47be-9f71-2ed0e875e77a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48232025-01-22T05:19:51.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d5587cbe-b8f8-47be-9f71-2ed0e875e77a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48242025-01-22T05:19:51.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d5587cbe-b8f8-47be-9f71-2ed0e875e77a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48252025-01-22T05:19:52.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b73e751d-a2dc-4504-8cd8-b87be61c795f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48262025-01-22T05:19:52.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b73e751d-a2dc-4504-8cd8-b87be61c795f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48272025-01-22T05:19:52.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b73e751d-a2dc-4504-8cd8-b87be61c795f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48282025-01-22T05:19:52.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
48292025-01-22T05:19:52.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48302025-01-22T05:19:52.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48312025-01-22T05:19:52.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
48322025-01-22T05:19:52.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48332025-01-22T05:19:52.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48342025-01-22T05:19:52.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48352025-01-22T05:19:52.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48362025-01-22T05:19:52.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48372025-01-22T05:19:52.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48382025-01-22T05:19:52.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48392025-01-22T05:19:52.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48402025-01-22T05:19:52.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48412025-01-22T05:19:52.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48422025-01-22T05:19:52.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48432025-01-22T05:19:52.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
48442025-01-22T05:19:52.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48452025-01-22T05:19:52.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48462025-01-22T05:19:52.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.396652ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48472025-01-22T05:19:52.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
48482025-01-22T05:19:52.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.440899ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
48492025-01-22T05:19:53.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d32035dd-f5b8-40ab-b308-a56a42ec8d6a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48502025-01-22T05:19:53.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d32035dd-f5b8-40ab-b308-a56a42ec8d6a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48512025-01-22T05:19:53.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d32035dd-f5b8-40ab-b308-a56a42ec8d6a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48522025-01-22T05:19:54.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 978187b6-51c1-4afd-b519-a6dac67d968b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48532025-01-22T05:19:54.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 978187b6-51c1-4afd-b519-a6dac67d968b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48542025-01-22T05:19:54.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 978187b6-51c1-4afd-b519-a6dac67d968b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48552025-01-22T05:19:55.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 107516b9-9f6a-4711-b1aa-a4db88600c8d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48562025-01-22T05:19:55.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 107516b9-9f6a-4711-b1aa-a4db88600c8d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48572025-01-22T05:19:55.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 107516b9-9f6a-4711-b1aa-a4db88600c8d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48582025-01-22T05:19:55.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 810 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 023c15cc-a850-400c-af3d-b67f84d6b3c3 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
48592025-01-22T05:19:56.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c30a5143-64e1-465c-8517-4b5e6e520ff6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48602025-01-22T05:19:56.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c30a5143-64e1-465c-8517-4b5e6e520ff6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48612025-01-22T05:19:56.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c30a5143-64e1-465c-8517-4b5e6e520ff6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48622025-01-22T05:19:57.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cf254dd6-12c1-4ffe-9dec-c121a4b249d4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48632025-01-22T05:19:57.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cf254dd6-12c1-4ffe-9dec-c121a4b249d4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48642025-01-22T05:19:57.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cf254dd6-12c1-4ffe-9dec-c121a4b249d4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48652025-01-22T05:19:58.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aed6f8f4-339f-43a0-bdcf-72b2f89b9bee roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48662025-01-22T05:19:58.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aed6f8f4-339f-43a0-bdcf-72b2f89b9bee resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48672025-01-22T05:19:58.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aed6f8f4-339f-43a0-bdcf-72b2f89b9bee response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48682025-01-22T05:19:59.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3e1c9bea-ad6b-437b-8120-e81922ab84d2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48692025-01-22T05:19:59.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3e1c9bea-ad6b-437b-8120-e81922ab84d2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48702025-01-22T05:19:59.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3e1c9bea-ad6b-437b-8120-e81922ab84d2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48712025-01-22T05:20:00.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b1ec3957-5c56-4a1b-b284-fd5cd9a3c7ca roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48722025-01-22T05:20:00.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b1ec3957-5c56-4a1b-b284-fd5cd9a3c7ca resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48732025-01-22T05:20:00.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b1ec3957-5c56-4a1b-b284-fd5cd9a3c7ca response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48742025-01-22T05:20:01.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 572cbfd0-7502-4c97-9183-200569fc0f1d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48752025-01-22T05:20:01.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 572cbfd0-7502-4c97-9183-200569fc0f1d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48762025-01-22T05:20:01.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 572cbfd0-7502-4c97-9183-200569fc0f1d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
48772025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
48782025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
48792025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48802025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
48812025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48822025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
48832025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
48842025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
48852025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48862025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
48872025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48882025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48892025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48902025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
48912025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48922025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
48932025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48942025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
48952025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48962025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48972025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48982025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48992025-01-22T05:20:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49002025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49012025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49022025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49032025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49042025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49052025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
49062025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
49072025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49082025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
49092025-01-22T05:20:02.824ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49102025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49112025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49122025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49132025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
49142025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49152025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49162025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49172025-01-22T05:20:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49182025-01-22T05:20:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49192025-01-22T05:20:02.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49202025-01-22T05:20:02.828ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.096174ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49212025-01-22T05:20:02.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49222025-01-22T05:20:02.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11385, tv_nsec: 177549232 } })
49232025-01-22T05:20:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49242025-01-22T05:20:02.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49252025-01-22T05:20:02.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
49262025-01-22T05:20:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49272025-01-22T05:20:02.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49282025-01-22T05:20:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49292025-01-22T05:20:02.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49302025-01-22T05:20:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49312025-01-22T05:20:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49322025-01-22T05:20:02.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49332025-01-22T05:20:02.833ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342025-01-22T05:20:02.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49352025-01-22T05:20:02.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11385, tv_nsec: 181958962 } })
49362025-01-22T05:20:02.834ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
49372025-01-22T05:20:02.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49382025-01-22T05:20:02.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49392025-01-22T05:20:02.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49402025-01-22T05:20:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
49412025-01-22T05:20:02.835ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49422025-01-22T05:20:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49432025-01-22T05:20:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49442025-01-22T05:20:02.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49452025-01-22T05:20:02.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49462025-01-22T05:20:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49472025-01-22T05:20:02.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49482025-01-22T05:20:02.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49492025-01-22T05:20:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49502025-01-22T05:20:02.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49512025-01-22T05:20:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49522025-01-22T05:20:02.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 18.767352ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49532025-01-22T05:20:02.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49542025-01-22T05:20:02.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49552025-01-22T05:20:02.844ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11385, tv_nsec: 192092268 } })
49562025-01-22T05:20:02.844ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
49572025-01-22T05:20:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
49582025-01-22T05:20:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49592025-01-22T05:20:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
49602025-01-22T05:20:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49612025-01-22T05:20:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
49622025-01-22T05:20:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49632025-01-22T05:20:02.844ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
49642025-01-22T05:20:02.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49652025-01-22T05:20:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49662025-01-22T05:20:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49672025-01-22T05:20:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49682025-01-22T05:20:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49692025-01-22T05:20:02.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49702025-01-22T05:20:02.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49712025-01-22T05:20:02.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49722025-01-22T05:20:02.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49732025-01-22T05:20:02.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
49742025-01-22T05:20:02.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49752025-01-22T05:20:02.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49762025-01-22T05:20:02.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49772025-01-22T05:20:02.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
49782025-01-22T05:20:02.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.671233ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
49792025-01-22T05:20:02.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49802025-01-22T05:20:02.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49812025-01-22T05:20:02.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49822025-01-22T05:20:02.886ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49832025-01-22T05:20:02.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49842025-01-22T05:20:02.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49852025-01-22T05:20:02.887ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49862025-01-22T05:20:02.887ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49872025-01-22T05:20:02.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49882025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49892025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49902025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49912025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.611198ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
49922025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49932025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49942025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49952025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49962025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
49972025-01-22T05:20:02.888ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49982025-01-22T05:20:02.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49992025-01-22T05:20:02.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.871114ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
50002025-01-22T05:20:02.890ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50012025-01-22T05:20:02.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50022025-01-22T05:20:02.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50032025-01-22T05:20:02.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50042025-01-22T05:20:02.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50052025-01-22T05:20:02.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.644028ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50062025-01-22T05:20:02.904ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50072025-01-22T05:20:02.904ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.281745ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50082025-01-22T05:20:02.906ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50092025-01-22T05:20:02.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50102025-01-22T05:20:02.918ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
50112025-01-22T05:20:02.918ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50122025-01-22T05:20:02.918ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d84384ba-27ec-4e40-8e8b-4fb0c109e827", "content-length": "26", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
50132025-01-22T05:20:02.918ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50142025-01-22T05:20:02.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50152025-01-22T05:20:02.921ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50162025-01-22T05:20:02.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50172025-01-22T05:20:02.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50182025-01-22T05:20:02.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50192025-01-22T05:20:02.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50202025-01-22T05:20:02.929ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
50212025-01-22T05:20:02.929ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 106.390127ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
50222025-01-22T05:20:02.930ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
50232025-01-22T05:20:02.930ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50242025-01-22T05:20:02.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
50252025-01-22T05:20:02.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50262025-01-22T05:20:02.930ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb819c36-333e-4242-b161-3e9786ebf678", "content-length": "26", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
50272025-01-22T05:20:02.930ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50282025-01-22T05:20:02.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50292025-01-22T05:20:02.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50302025-01-22T05:20:02.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50312025-01-22T05:20:02.932ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50322025-01-22T05:20:02.932ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50332025-01-22T05:20:02.932ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50342025-01-22T05:20:02.932ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50352025-01-22T05:20:02.933ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.533632ms iteration = 20 status = 0
50362025-01-22T05:20:02.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50372025-01-22T05:20:02.948ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50382025-01-22T05:20:02.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.361936ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50392025-01-22T05:20:02.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50402025-01-22T05:20:02.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
50412025-01-22T05:20:02.963ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50422025-01-22T05:20:02.963ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8542ee3b-86bd-48c1-a73b-47c72b81d9c9", "content-length": "26", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
50432025-01-22T05:20:02.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50442025-01-22T05:20:02.967ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
50452025-01-22T05:20:02.982ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.259794ms iteration = 22 status = {"physical_disks_added":0}
50462025-01-22T05:20:02.988ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50472025-01-22T05:20:02.988ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50482025-01-22T05:20:02.988ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 163.685874ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50492025-01-22T05:20:02.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.62129ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
50502025-01-22T05:20:03.022ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50512025-01-22T05:20:03.023ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a22e326a-0b94-48f5-a812-25fd77dd26f9", "content-length": "1", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
50522025-01-22T05:20:03.025ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50532025-01-22T05:20:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50542025-01-22T05:20:03.028ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 204.811652ms iteration = 20 status = null
50552025-01-22T05:20:03.051ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 227.79323ms iteration = 20 status = {}
50562025-01-22T05:20:03.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50572025-01-22T05:20:03.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50582025-01-22T05:20:03.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50592025-01-22T05:20:03.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 48ceb776-ed37-459c-a519-cd3ff2726864 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
50602025-01-22T05:20:03.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 48ceb776-ed37-459c-a519-cd3ff2726864 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
50612025-01-22T05:20:03.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50622025-01-22T05:20:03.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50632025-01-22T05:20:03.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50642025-01-22T05:20:03.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 48ceb776-ed37-459c-a519-cd3ff2726864 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
50652025-01-22T05:20:03.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50662025-01-22T05:20:03.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50672025-01-22T05:20:03.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50682025-01-22T05:20:03.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50692025-01-22T05:20:03.089ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50702025-01-22T05:20:03.089ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50712025-01-22T05:20:03.090ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b94370da-7687-4c78-b30d-cca30400c94b", "content-length": "372", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
50722025-01-22T05:20:03.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50732025-01-22T05:20:03.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50742025-01-22T05:20:03.107ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50752025-01-22T05:20:03.107ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50762025-01-22T05:20:03.108ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "19e405a6-4056-46f7-9f3a-6d230dde6d34", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
50772025-01-22T05:20:03.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50782025-01-22T05:20:03.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50792025-01-22T05:20:03.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50802025-01-22T05:20:03.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50812025-01-22T05:20:03.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50822025-01-22T05:20:03.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50832025-01-22T05:20:03.116ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50842025-01-22T05:20:03.116ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50852025-01-22T05:20:03.117ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "80ba5115-ef9a-43dd-b411-ba76be0309f4", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
50862025-01-22T05:20:03.118ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 294.129581ms iteration = 20 status = {}
50872025-01-22T05:20:03.154ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50882025-01-22T05:20:03.155ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "061c3ac6-6587-41fc-b6ee-a401636dada3", "content-length": "691", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
50892025-01-22T05:20:03.155ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50902025-01-22T05:20:03.155ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50912025-01-22T05:20:03.155ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50922025-01-22T05:20:03.157ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 333.79562ms iteration = 20 status = {}
50932025-01-22T05:20:03.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50942025-01-22T05:20:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50952025-01-22T05:20:03.177ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
50962025-01-22T05:20:03.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50972025-01-22T05:20:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50982025-01-22T05:20:03.186ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50992025-01-22T05:20:03.187ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "10e1d292-2df4-428e-a288-275188074e5a", "content-length": "134", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
51002025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51012025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
51022025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51032025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51042025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51052025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51062025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51072025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51082025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51092025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51102025-01-22T05:20:03.187ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
51112025-01-22T05:20:03.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51122025-01-22T05:20:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51132025-01-22T05:20:03.189ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51142025-01-22T05:20:03.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5df5321c-f23f-4e11-b1b9-37ea04968856", "content-length": "2", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
51152025-01-22T05:20:03.189ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51162025-01-22T05:20:03.189ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c916887-7c9a-41f7-9593-6ac7f0e0d2ad", "content-length": "51", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
51172025-01-22T05:20:03.189ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
51182025-01-22T05:20:03.189ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51192025-01-22T05:20:03.289ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "63ce12b4-2837-48bc-bce6-f4c83121a4ae", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
51202025-01-22T05:20:03.289ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
51212025-01-22T05:20:03.289ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51222025-01-22T05:20:03.289ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "979a8be6-f12a-4036-b6da-5e422dcac90b", "content-length": "682", "date": "Wed, 22 Jan 2025 05:20:02 GMT"} })
51232025-01-22T05:20:03.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51242025-01-22T05:20:03.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51252025-01-22T05:20:03.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51262025-01-22T05:20:03.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51272025-01-22T05:20:03.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51282025-01-22T05:20:03.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51292025-01-22T05:20:03.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51302025-01-22T05:20:03.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51312025-01-22T05:20:03.306ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 482.960258ms iteration = 20 status = {}
51322025-01-22T05:20:03.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 52a7341a-3450-4feb-b318-b8e3f46903cd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51332025-01-22T05:20:03.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 52a7341a-3450-4feb-b318-b8e3f46903cd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51342025-01-22T05:20:03.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 52a7341a-3450-4feb-b318-b8e3f46903cd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51352025-01-22T05:20:04.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7d118999-570c-4bb6-8622-1e42193499e0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51362025-01-22T05:20:04.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7d118999-570c-4bb6-8622-1e42193499e0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51372025-01-22T05:20:04.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7d118999-570c-4bb6-8622-1e42193499e0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51382025-01-22T05:20:05.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6179c154-cf7d-4a76-91bd-e62157484d7a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51392025-01-22T05:20:05.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6179c154-cf7d-4a76-91bd-e62157484d7a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51402025-01-22T05:20:05.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6179c154-cf7d-4a76-91bd-e62157484d7a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51412025-01-22T05:20:05.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 507 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 8bca47ea-e97f-478a-8d4a-eee3e4a41721 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
51422025-01-22T05:20:06.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e6de5f5b-2a88-4d30-b664-3d7a3be55398 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51432025-01-22T05:20:06.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e6de5f5b-2a88-4d30-b664-3d7a3be55398 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51442025-01-22T05:20:06.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e6de5f5b-2a88-4d30-b664-3d7a3be55398 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51452025-01-22T05:20:07.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4544f03f-d713-4de7-9d8d-afb8a99fd09f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51462025-01-22T05:20:07.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4544f03f-d713-4de7-9d8d-afb8a99fd09f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51472025-01-22T05:20:07.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4544f03f-d713-4de7-9d8d-afb8a99fd09f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51482025-01-22T05:20:08.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba59fd5f-b3d7-4767-a43f-16d83e4ea0a1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51492025-01-22T05:20:08.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba59fd5f-b3d7-4767-a43f-16d83e4ea0a1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51502025-01-22T05:20:08.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba59fd5f-b3d7-4767-a43f-16d83e4ea0a1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51512025-01-22T05:20:09.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ef96f244-77c6-4d4a-adb5-52ed8233127a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51522025-01-22T05:20:09.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ef96f244-77c6-4d4a-adb5-52ed8233127a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51532025-01-22T05:20:09.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ef96f244-77c6-4d4a-adb5-52ed8233127a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51542025-01-22T05:20:10.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c17db754-f37e-48eb-b4f6-69e9135fffb2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51552025-01-22T05:20:10.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c17db754-f37e-48eb-b4f6-69e9135fffb2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51562025-01-22T05:20:10.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c17db754-f37e-48eb-b4f6-69e9135fffb2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51572025-01-22T05:20:11.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72c524bd-c517-4ba4-91a0-9c5a345d1b7b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51582025-01-22T05:20:11.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72c524bd-c517-4ba4-91a0-9c5a345d1b7b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51592025-01-22T05:20:11.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72c524bd-c517-4ba4-91a0-9c5a345d1b7b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51602025-01-22T05:20:12.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 18dc3bc5-e794-426f-aba0-a0a84eaba33f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51612025-01-22T05:20:12.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 18dc3bc5-e794-426f-aba0-a0a84eaba33f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51622025-01-22T05:20:12.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 18dc3bc5-e794-426f-aba0-a0a84eaba33f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51632025-01-22T05:20:12.822ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
51642025-01-22T05:20:12.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51652025-01-22T05:20:12.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51662025-01-22T05:20:12.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
51672025-01-22T05:20:12.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51682025-01-22T05:20:12.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51692025-01-22T05:20:12.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51702025-01-22T05:20:12.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51712025-01-22T05:20:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51722025-01-22T05:20:12.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51732025-01-22T05:20:12.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51742025-01-22T05:20:12.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51752025-01-22T05:20:12.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.94063ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51762025-01-22T05:20:12.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51772025-01-22T05:20:12.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51782025-01-22T05:20:12.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51792025-01-22T05:20:12.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
51802025-01-22T05:20:12.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51812025-01-22T05:20:12.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51822025-01-22T05:20:12.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
51832025-01-22T05:20:12.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.083241ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
51842025-01-22T05:20:13.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8edb89aa-025d-4cdb-9f49-148158062f99 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51852025-01-22T05:20:13.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8edb89aa-025d-4cdb-9f49-148158062f99 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51862025-01-22T05:20:13.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8edb89aa-025d-4cdb-9f49-148158062f99 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51872025-01-22T05:20:14.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a438c6d9-d741-47e1-aeed-4fba875e0f5f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51882025-01-22T05:20:14.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a438c6d9-d741-47e1-aeed-4fba875e0f5f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51892025-01-22T05:20:14.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a438c6d9-d741-47e1-aeed-4fba875e0f5f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51902025-01-22T05:20:15.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1bacf9df-4897-4dd4-83e6-c9b727577512 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51912025-01-22T05:20:15.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1bacf9df-4897-4dd4-83e6-c9b727577512 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51922025-01-22T05:20:15.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1bacf9df-4897-4dd4-83e6-c9b727577512 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51932025-01-22T05:20:15.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 874 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 80fe8d85-8e06-4df5-b7b4-24cf7127e16c response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
51942025-01-22T05:20:16.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = abb27499-ee93-4db2-9671-f8b4318c0cfa roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51952025-01-22T05:20:16.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = abb27499-ee93-4db2-9671-f8b4318c0cfa resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51962025-01-22T05:20:16.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = abb27499-ee93-4db2-9671-f8b4318c0cfa response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51972025-01-22T05:20:17.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eccf5efb-d6a3-41bc-a3ef-ad7f6159579c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51982025-01-22T05:20:17.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eccf5efb-d6a3-41bc-a3ef-ad7f6159579c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
51992025-01-22T05:20:17.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = eccf5efb-d6a3-41bc-a3ef-ad7f6159579c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52002025-01-22T05:20:18.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 415b90d1-2aa5-430c-8620-82ced1648b93 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52012025-01-22T05:20:18.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 415b90d1-2aa5-430c-8620-82ced1648b93 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52022025-01-22T05:20:18.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 415b90d1-2aa5-430c-8620-82ced1648b93 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52032025-01-22T05:20:19.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6656a5a9-0696-4b63-a563-78a7bc9043c6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52042025-01-22T05:20:19.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6656a5a9-0696-4b63-a563-78a7bc9043c6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52052025-01-22T05:20:19.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6656a5a9-0696-4b63-a563-78a7bc9043c6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52062025-01-22T05:20:20.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 168ec047-26ad-4836-bd8f-b2fa825bb73a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52072025-01-22T05:20:20.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 168ec047-26ad-4836-bd8f-b2fa825bb73a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52082025-01-22T05:20:20.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 168ec047-26ad-4836-bd8f-b2fa825bb73a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52092025-01-22T05:20:21.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d4bd3d4-b119-4f4c-aa55-a53880d4dd4d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52102025-01-22T05:20:21.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d4bd3d4-b119-4f4c-aa55-a53880d4dd4d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52112025-01-22T05:20:21.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d4bd3d4-b119-4f4c-aa55-a53880d4dd4d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52122025-01-22T05:20:22.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a94c0550-c8ae-445d-9d81-1261beadfcc1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52132025-01-22T05:20:22.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a94c0550-c8ae-445d-9d81-1261beadfcc1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52142025-01-22T05:20:22.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a94c0550-c8ae-445d-9d81-1261beadfcc1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52152025-01-22T05:20:22.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
52162025-01-22T05:20:22.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52172025-01-22T05:20:22.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52182025-01-22T05:20:22.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
52192025-01-22T05:20:22.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52202025-01-22T05:20:22.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52212025-01-22T05:20:22.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52222025-01-22T05:20:22.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52232025-01-22T05:20:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52242025-01-22T05:20:22.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52252025-01-22T05:20:22.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52262025-01-22T05:20:22.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52272025-01-22T05:20:22.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.860708ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52282025-01-22T05:20:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52292025-01-22T05:20:22.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52302025-01-22T05:20:22.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52312025-01-22T05:20:22.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
52322025-01-22T05:20:22.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52332025-01-22T05:20:22.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52342025-01-22T05:20:22.843ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
52352025-01-22T05:20:22.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.14998ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
52362025-01-22T05:20:23.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 960a4111-9036-47eb-8f6b-434ca5e975fb roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52372025-01-22T05:20:23.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 960a4111-9036-47eb-8f6b-434ca5e975fb resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52382025-01-22T05:20:23.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 960a4111-9036-47eb-8f6b-434ca5e975fb response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52392025-01-22T05:20:24.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d3703503-b8a8-4420-bd4f-c9490a149e56 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52402025-01-22T05:20:24.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d3703503-b8a8-4420-bd4f-c9490a149e56 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52412025-01-22T05:20:24.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d3703503-b8a8-4420-bd4f-c9490a149e56 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52422025-01-22T05:20:25.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 747a4284-6658-49dc-b5a4-c3dc169ea70e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52432025-01-22T05:20:25.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 747a4284-6658-49dc-b5a4-c3dc169ea70e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52442025-01-22T05:20:25.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 747a4284-6658-49dc-b5a4-c3dc169ea70e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52452025-01-22T05:20:25.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 573 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 58861902-027c-479e-88b4-cb189138bd9d response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
52462025-01-22T05:20:26.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7692b743-2c45-461c-baed-2515c7af97d2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52472025-01-22T05:20:26.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7692b743-2c45-461c-baed-2515c7af97d2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52482025-01-22T05:20:26.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7692b743-2c45-461c-baed-2515c7af97d2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52492025-01-22T05:20:27.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a0942610-123d-4da7-b34f-bf6530916490 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52502025-01-22T05:20:27.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a0942610-123d-4da7-b34f-bf6530916490 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52512025-01-22T05:20:27.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a0942610-123d-4da7-b34f-bf6530916490 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52522025-01-22T05:20:28.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1c07c91e-9cf5-4f57-a432-ad329a20c0d3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52532025-01-22T05:20:28.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1c07c91e-9cf5-4f57-a432-ad329a20c0d3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52542025-01-22T05:20:28.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1c07c91e-9cf5-4f57-a432-ad329a20c0d3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52552025-01-22T05:20:29.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6312080c-75e0-499c-8748-6a1155c35908 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52562025-01-22T05:20:29.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6312080c-75e0-499c-8748-6a1155c35908 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52572025-01-22T05:20:29.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6312080c-75e0-499c-8748-6a1155c35908 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52582025-01-22T05:20:30.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f61c84e0-0dd1-47f4-98f5-c4e2e4219caa roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52592025-01-22T05:20:30.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f61c84e0-0dd1-47f4-98f5-c4e2e4219caa resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52602025-01-22T05:20:30.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f61c84e0-0dd1-47f4-98f5-c4e2e4219caa response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52612025-01-22T05:20:31.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 738857ac-120b-4272-bdb9-b519f13fad78 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52622025-01-22T05:20:31.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 738857ac-120b-4272-bdb9-b519f13fad78 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52632025-01-22T05:20:31.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 738857ac-120b-4272-bdb9-b519f13fad78 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52642025-01-22T05:20:32.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aa154c62-ebae-4968-9e8a-487c6027d3e7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52652025-01-22T05:20:32.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aa154c62-ebae-4968-9e8a-487c6027d3e7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52662025-01-22T05:20:32.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aa154c62-ebae-4968-9e8a-487c6027d3e7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
52672025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
52682025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52692025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
52702025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52712025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
52722025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
52732025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52742025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52752025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52762025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
52772025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
52782025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52792025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52802025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
52812025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
52822025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
52832025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52842025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52852025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
52862025-01-22T05:20:32.823ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
52872025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.11\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
52882025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
52892025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
52902025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
52912025-01-22T05:20:32.823ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:10:32.823545320 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52922025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52932025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52942025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
52952025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
52962025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
52972025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
52982025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52992025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53002025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53012025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
53022025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
53032025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53042025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
53052025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53062025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
53072025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53082025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
53092025-01-22T05:20:32.823ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53102025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53112025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53122025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53132025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53142025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53152025-01-22T05:20:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53162025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53172025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53182025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53192025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53202025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
53212025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
53222025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53232025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53242025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53252025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53262025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
53272025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53282025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
53292025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53302025-01-22T05:20:32.824ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53312025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53322025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
53332025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
53342025-01-22T05:20:32.824ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
53352025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53362025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
53372025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53382025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53392025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53402025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53412025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53422025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
53432025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53442025-01-22T05:20:32.824ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11415, tv_nsec: 171923637 } })
53452025-01-22T05:20:32.824ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11415, tv_nsec: 171924017 } })
53462025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53472025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53482025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53492025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53502025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53512025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53522025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53532025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
53542025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.377838ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
53552025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
53562025-01-22T05:20:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.360528ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
53572025-01-22T05:20:32.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53582025-01-22T05:20:32.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53592025-01-22T05:20:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53602025-01-22T05:20:32.826ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53612025-01-22T05:20:32.827ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.300508ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53622025-01-22T05:20:32.828ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11415, tv_nsec: 175697174 } })
53632025-01-22T05:20:32.828ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
53642025-01-22T05:20:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53652025-01-22T05:20:32.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53662025-01-22T05:20:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53672025-01-22T05:20:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
53682025-01-22T05:20:32.828ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53692025-01-22T05:20:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53702025-01-22T05:20:32.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53712025-01-22T05:20:32.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53722025-01-22T05:20:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53732025-01-22T05:20:32.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53742025-01-22T05:20:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53752025-01-22T05:20:32.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53762025-01-22T05:20:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53772025-01-22T05:20:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
53782025-01-22T05:20:32.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53792025-01-22T05:20:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53802025-01-22T05:20:32.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11415, tv_nsec: 183716517 } })
53812025-01-22T05:20:32.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
53822025-01-22T05:20:32.839ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:10:32.823545320 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53832025-01-22T05:20:32.839ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.18443ms iteration = 11 status = {"expiration":"2025-01-22T05:10:32.823545320Z","pruned":[]}
53842025-01-22T05:20:32.840ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53852025-01-22T05:20:32.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53862025-01-22T05:20:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
53872025-01-22T05:20:32.843ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53882025-01-22T05:20:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
53892025-01-22T05:20:32.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53902025-01-22T05:20:32.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53912025-01-22T05:20:32.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53922025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
53932025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53942025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
53952025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53962025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
53972025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
53982025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53992025-01-22T05:20:32.845ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
54002025-01-22T05:20:32.845ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
54012025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
54022025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54032025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
54042025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54052025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54062025-01-22T05:20:32.845ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
54072025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54082025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54092025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54102025-01-22T05:20:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54112025-01-22T05:20:32.846ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54122025-01-22T05:20:32.846ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54132025-01-22T05:20:32.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54142025-01-22T05:20:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54152025-01-22T05:20:32.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54162025-01-22T05:20:32.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54172025-01-22T05:20:32.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54182025-01-22T05:20:32.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54192025-01-22T05:20:32.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54202025-01-22T05:20:32.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54212025-01-22T05:20:32.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222025-01-22T05:20:32.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
54232025-01-22T05:20:32.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
54242025-01-22T05:20:32.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11415, tv_nsec: 203430619 } })
54252025-01-22T05:20:32.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
54262025-01-22T05:20:32.856ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.170728ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
54272025-01-22T05:20:32.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54282025-01-22T05:20:32.858ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(0ccd91c8-49cb-4516-8634-add6e224d9de, 0), (bfcb292b-bbb1-4b27-8d07-9691f593c383, 0), (b27e31c3-1e5b-4bf0-a390-52c12dfac332, 0)]
54292025-01-22T05:20:32.858ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11415, tv_nsec: 206209686 } })
54302025-01-22T05:20:32.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54312025-01-22T05:20:32.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54322025-01-22T05:20:32.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54332025-01-22T05:20:32.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54342025-01-22T05:20:32.874ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54352025-01-22T05:20:32.874ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54362025-01-22T05:20:32.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54372025-01-22T05:20:32.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54382025-01-22T05:20:32.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54392025-01-22T05:20:32.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54402025-01-22T05:20:32.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54412025-01-22T05:20:32.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54422025-01-22T05:20:32.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54432025-01-22T05:20:32.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54442025-01-22T05:20:32.878ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54452025-01-22T05:20:32.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54462025-01-22T05:20:32.881ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54472025-01-22T05:20:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54482025-01-22T05:20:32.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54492025-01-22T05:20:32.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54502025-01-22T05:20:32.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54512025-01-22T05:20:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54522025-01-22T05:20:32.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54532025-01-22T05:20:32.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54542025-01-22T05:20:32.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54552025-01-22T05:20:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54562025-01-22T05:20:32.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54572025-01-22T05:20:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54582025-01-22T05:20:32.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54592025-01-22T05:20:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54602025-01-22T05:20:32.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54612025-01-22T05:20:32.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54622025-01-22T05:20:32.900ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632025-01-22T05:20:32.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54642025-01-22T05:20:32.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54652025-01-22T05:20:32.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54662025-01-22T05:20:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54672025-01-22T05:20:32.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54682025-01-22T05:20:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54692025-01-22T05:20:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54702025-01-22T05:20:32.903ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54712025-01-22T05:20:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54722025-01-22T05:20:32.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.36921ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
54732025-01-22T05:20:32.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.683637ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
54742025-01-22T05:20:32.910ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54752025-01-22T05:20:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54762025-01-22T05:20:32.910ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54772025-01-22T05:20:32.910ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54782025-01-22T05:20:32.910ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54792025-01-22T05:20:32.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54802025-01-22T05:20:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54812025-01-22T05:20:32.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54822025-01-22T05:20:32.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54832025-01-22T05:20:32.912ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54842025-01-22T05:20:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54852025-01-22T05:20:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54862025-01-22T05:20:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54872025-01-22T05:20:32.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54882025-01-22T05:20:32.913ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54892025-01-22T05:20:32.913ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54902025-01-22T05:20:32.913ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 89.488653ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54912025-01-22T05:20:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54922025-01-22T05:20:32.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54932025-01-22T05:20:32.915ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
54942025-01-22T05:20:32.915ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 70.731141ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
54952025-01-22T05:20:32.916ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54962025-01-22T05:20:32.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54972025-01-22T05:20:32.917ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54982025-01-22T05:20:32.917ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54992025-01-22T05:20:32.917ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55002025-01-22T05:20:32.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55012025-01-22T05:20:32.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55022025-01-22T05:20:32.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55032025-01-22T05:20:32.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55042025-01-22T05:20:32.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55052025-01-22T05:20:32.922ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55062025-01-22T05:20:32.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55072025-01-22T05:20:32.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55082025-01-22T05:20:32.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55092025-01-22T05:20:32.926ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55102025-01-22T05:20:32.926ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
55112025-01-22T05:20:32.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55122025-01-22T05:20:32.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55132025-01-22T05:20:32.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
55142025-01-22T05:20:32.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55152025-01-22T05:20:32.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55162025-01-22T05:20:32.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55172025-01-22T05:20:32.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55182025-01-22T05:20:32.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55192025-01-22T05:20:32.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55202025-01-22T05:20:32.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55212025-01-22T05:20:32.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55222025-01-22T05:20:32.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55232025-01-22T05:20:32.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55242025-01-22T05:20:32.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55252025-01-22T05:20:32.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55262025-01-22T05:20:32.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 115.992583ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55272025-01-22T05:20:32.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
55282025-01-22T05:20:32.941ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55292025-01-22T05:20:32.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55302025-01-22T05:20:32.944ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55312025-01-22T05:20:32.945ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
55322025-01-22T05:20:32.945ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55332025-01-22T05:20:32.945ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
55342025-01-22T05:20:32.945ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 121.773331ms iteration = 11 status = {"generation":2}
55352025-01-22T05:20:32.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
55362025-01-22T05:20:32.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55372025-01-22T05:20:32.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55382025-01-22T05:20:32.947ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55392025-01-22T05:20:32.947ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55402025-01-22T05:20:32.947ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.451695ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55412025-01-22T05:20:32.949ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 126.191471ms iteration = 5 status = {}
55422025-01-22T05:20:32.951ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55432025-01-22T05:20:32.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55442025-01-22T05:20:32.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.497938ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55452025-01-22T05:20:32.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.879148ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55462025-01-22T05:20:32.953ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
55472025-01-22T05:20:32.953ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.627731ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
55482025-01-22T05:20:32.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55492025-01-22T05:20:32.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55502025-01-22T05:20:32.958ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55512025-01-22T05:20:32.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55522025-01-22T05:20:32.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55532025-01-22T05:20:32.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55542025-01-22T05:20:32.960ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55552025-01-22T05:20:32.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55562025-01-22T05:20:32.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55572025-01-22T05:20:32.961ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55582025-01-22T05:20:32.961ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55592025-01-22T05:20:32.961ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 138.007671ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55602025-01-22T05:20:32.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
55612025-01-22T05:20:32.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55622025-01-22T05:20:32.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
55632025-01-22T05:20:32.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55642025-01-22T05:20:32.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55652025-01-22T05:20:32.965ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55662025-01-22T05:20:32.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55672025-01-22T05:20:32.965ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55682025-01-22T05:20:32.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 141.801988ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55692025-01-22T05:20:32.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
55702025-01-22T05:20:32.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55712025-01-22T05:20:32.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55722025-01-22T05:20:32.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
55732025-01-22T05:20:32.967ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55742025-01-22T05:20:32.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55752025-01-22T05:20:32.970ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.063596ms iteration = 21 status = 0
55762025-01-22T05:20:32.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55772025-01-22T05:20:32.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55782025-01-22T05:20:32.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55792025-01-22T05:20:32.977ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55802025-01-22T05:20:32.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55812025-01-22T05:20:32.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55822025-01-22T05:20:32.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55832025-01-22T05:20:32.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55842025-01-22T05:20:32.980ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55852025-01-22T05:20:32.981ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55862025-01-22T05:20:32.981ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55872025-01-22T05:20:32.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55882025-01-22T05:20:32.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55892025-01-22T05:20:32.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55902025-01-22T05:20:32.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55912025-01-22T05:20:32.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.198604ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
55922025-01-22T05:20:32.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55932025-01-22T05:20:32.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
55942025-01-22T05:20:32.990ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55952025-01-22T05:20:32.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55962025-01-22T05:20:32.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55972025-01-22T05:20:32.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55982025-01-22T05:20:32.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55992025-01-22T05:20:32.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56002025-01-22T05:20:32.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56012025-01-22T05:20:32.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56022025-01-22T05:20:32.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56032025-01-22T05:20:32.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56042025-01-22T05:20:33.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56052025-01-22T05:20:33.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56062025-01-22T05:20:33.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56072025-01-22T05:20:33.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56082025-01-22T05:20:33.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56092025-01-22T05:20:33.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56102025-01-22T05:20:33.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56112025-01-22T05:20:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
56122025-01-22T05:20:33.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56132025-01-22T05:20:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56142025-01-22T05:20:33.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56152025-01-22T05:20:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56162025-01-22T05:20:33.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56172025-01-22T05:20:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56182025-01-22T05:20:33.015ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
56192025-01-22T05:20:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 191.834098ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
56202025-01-22T05:20:33.015ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56212025-01-22T05:20:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56222025-01-22T05:20:33.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56232025-01-22T05:20:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56242025-01-22T05:20:33.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56252025-01-22T05:20:33.024ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
56262025-01-22T05:20:33.024ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 200.814561ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56272025-01-22T05:20:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56282025-01-22T05:20:33.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56292025-01-22T05:20:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56302025-01-22T05:20:33.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56312025-01-22T05:20:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56322025-01-22T05:20:33.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56332025-01-22T05:20:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56342025-01-22T05:20:33.028ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
56352025-01-22T05:20:33.028ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56362025-01-22T05:20:33.028ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
56372025-01-22T05:20:33.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 204.589498ms iteration = 11 status = {"generation":1}
56382025-01-22T05:20:33.029ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56392025-01-22T05:20:33.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
56402025-01-22T05:20:33.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56412025-01-22T05:20:33.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56422025-01-22T05:20:33.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56432025-01-22T05:20:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56442025-01-22T05:20:33.035ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 211.681112ms iteration = 23 status = {"physical_disks_added":0}
56452025-01-22T05:20:33.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56462025-01-22T05:20:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56472025-01-22T05:20:33.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56482025-01-22T05:20:33.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
56492025-01-22T05:20:33.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56502025-01-22T05:20:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56512025-01-22T05:20:33.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56522025-01-22T05:20:33.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56532025-01-22T05:20:33.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56542025-01-22T05:20:33.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56552025-01-22T05:20:33.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56562025-01-22T05:20:33.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56572025-01-22T05:20:33.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56582025-01-22T05:20:33.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56592025-01-22T05:20:33.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56602025-01-22T05:20:33.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56612025-01-22T05:20:33.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56622025-01-22T05:20:33.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56632025-01-22T05:20:33.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56642025-01-22T05:20:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56652025-01-22T05:20:33.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56662025-01-22T05:20:33.071ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
56672025-01-22T05:20:33.071ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
56682025-01-22T05:20:33.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
56692025-01-22T05:20:33.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
56702025-01-22T05:20:33.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56712025-01-22T05:20:33.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56722025-01-22T05:20:33.072ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "749ac265-2301-4611-8060-d9ecfa624e1c", "content-length": "476", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56732025-01-22T05:20:33.072ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
56742025-01-22T05:20:33.072ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "42a8bc25-c032-4b84-9def-7433c3d4242f", "content-length": "734", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56752025-01-22T05:20:33.072ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
56762025-01-22T05:20:33.072ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "54e62537-a9ad-4922-9a5a-0efbcf7cced9", "content-length": "111", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56772025-01-22T05:20:33.072ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
56782025-01-22T05:20:33.073ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa03a344-47cc-44f1-8b51-bdc568f9cdf9", "content-length": "111", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56792025-01-22T05:20:33.073ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
56802025-01-22T05:20:33.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56812025-01-22T05:20:33.073ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff1c8b4c-ddcd-4541-ab43-443626a7f14e", "content-length": "167", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56822025-01-22T05:20:33.073ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
56832025-01-22T05:20:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56842025-01-22T05:20:33.073ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ad88dca-5e3e-4f7d-8bdb-f89ebff8a9ab", "content-length": "167", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56852025-01-22T05:20:33.073ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
56862025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b69caf2-78cf-45fc-ad3e-f0bc2244a7a4", "content-length": "175", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56872025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
56882025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "737bbcb3-490b-4ead-91c3-479cd434e17e", "content-length": "175", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56892025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
56902025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "af2a5e03-c79f-44bb-bce6-72b5bbf51ccb", "content-length": "702", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56912025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
56922025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b187843d-9ef9-43f4-a9bb-0bf690c98d34", "content-length": "727", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56932025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
56942025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c37df744-5381-4528-8e55-33e54231fd57", "content-length": "729", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56952025-01-22T05:20:33.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
56962025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56972025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3063dac-0e8a-40da-b29c-ef71e7caf759", "content-length": "728", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
56982025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
56992025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbc4e967-fcb7-4df2-9cf7-5281cf80b788", "content-length": "722", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57002025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57012025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
57022025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "909dc706-5328-4d41-90fd-c16802962c57", "content-length": "109", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57032025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
57042025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ad04858-e35e-4bd3-b612-bae941b5e2e1", "content-length": "109", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57052025-01-22T05:20:33.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
57062025-01-22T05:20:33.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "59f7fcbc-8667-45b2-a0be-99009d893f86", "content-length": "169", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57072025-01-22T05:20:33.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
57082025-01-22T05:20:33.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fafdd9ec-bccd-4734-84ea-47be719a6d0e", "content-length": "169", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57092025-01-22T05:20:33.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
57102025-01-22T05:20:33.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57112025-01-22T05:20:33.076ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "53b36dd5-2b54-40f2-b832-1572340c6ef8", "content-length": "178", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57122025-01-22T05:20:33.076ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
57132025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9db88648-772a-47e5-9c24-aefd6bb734b3", "content-length": "178", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57142025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
57152025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f679680-e8ce-4918-beb5-2badaec9a3b6", "content-length": "702", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57162025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
57172025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4742d517-4052-464b-9a9c-e047d308e30a", "content-length": "727", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57182025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
57192025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "44aa576e-ee53-4f58-8127-64b8bc653279", "content-length": "729", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57202025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
57212025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "45287a7f-d509-4684-88a8-63cda7581a22", "content-length": "728", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57222025-01-22T05:20:33.077ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57232025-01-22T05:20:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
57242025-01-22T05:20:33.079ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57252025-01-22T05:20:33.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
57262025-01-22T05:20:33.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57272025-01-22T05:20:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57282025-01-22T05:20:33.081ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
57292025-01-22T05:20:33.081ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 257.417674ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
57302025-01-22T05:20:33.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
57312025-01-22T05:20:33.082ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57322025-01-22T05:20:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
57332025-01-22T05:20:33.083ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57342025-01-22T05:20:33.086ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
57352025-01-22T05:20:33.086ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57362025-01-22T05:20:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
57372025-01-22T05:20:33.087ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 9396e9bd-ba9d-48e4-a278-7b7b84c18361, kind: Service { id: 1921c966-20bc-43ec-90bc-8bb3cb3c388f }, name: Name("nexus-1921c966-20bc-43ec-90bc-8bb3cb3c388f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6d43724-d167-4d59-9642-c64ff9718927, kind: Service { id: 3fbe3917-aca1-4b36-8119-948b03a24746 }, name: Name("nexus-3fbe3917-aca1-4b36-8119-948b03a24746"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dfba0bbc-9240-4b6a-84cb-7ae51a2f8f8a, kind: Service { id: 5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a }, name: Name("nexus-5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 603573fe-43d9-432a-ad48-f1cdca1d4167, kind: Service { id: c7d22dc6-a1ac-4ae2-9658-16be14c1294a }, name: Name("external-dns-c7d22dc6-a1ac-4ae2-9658-16be14c1294a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 165])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9917397f-ffee-49ec-b869-d35b0b743c02, kind: Service { id: 358028b5-56dd-4575-bbf5-bf3b9b03d80f }, name: Name("external-dns-358028b5-56dd-4575-bbf5-bf3b9b03d80f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 38])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
57382025-01-22T05:20:33.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57392025-01-22T05:20:33.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57402025-01-22T05:20:33.089ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57412025-01-22T05:20:33.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
57422025-01-22T05:20:33.090ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57432025-01-22T05:20:33.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57442025-01-22T05:20:33.092ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
57452025-01-22T05:20:33.092ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 603573fe-43d9-432a-ad48-f1cdca1d4167, kind: Service { id: c7d22dc6-a1ac-4ae2-9658-16be14c1294a }, name: Name("external-dns-c7d22dc6-a1ac-4ae2-9658-16be14c1294a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 165])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9917397f-ffee-49ec-b869-d35b0b743c02, kind: Service { id: 358028b5-56dd-4575-bbf5-bf3b9b03d80f }, name: Name("external-dns-358028b5-56dd-4575-bbf5-bf3b9b03d80f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 38])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 9396e9bd-ba9d-48e4-a278-7b7b84c18361, kind: Service { id: 1921c966-20bc-43ec-90bc-8bb3cb3c388f }, name: Name("nexus-1921c966-20bc-43ec-90bc-8bb3cb3c388f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6d43724-d167-4d59-9642-c64ff9718927, kind: Service { id: 3fbe3917-aca1-4b36-8119-948b03a24746 }, name: Name("nexus-3fbe3917-aca1-4b36-8119-948b03a24746"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dfba0bbc-9240-4b6a-84cb-7ae51a2f8f8a, kind: Service { id: 5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a }, name: Name("nexus-5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
57462025-01-22T05:20:33.092ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
57472025-01-22T05:20:33.112ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
57482025-01-22T05:20:33.127ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57492025-01-22T05:20:33.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57502025-01-22T05:20:33.139ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
57512025-01-22T05:20:33.139ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57522025-01-22T05:20:33.139ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32fa454a-f276-4789-bef2-7873b414a8a3", "content-length": "26", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57532025-01-22T05:20:33.139ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57542025-01-22T05:20:33.143ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57552025-01-22T05:20:33.157ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
57562025-01-22T05:20:33.157ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57572025-01-22T05:20:33.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57582025-01-22T05:20:33.157ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "51deced2-4011-4c9c-b526-296636ac6d34", "content-length": "26", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57592025-01-22T05:20:33.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57602025-01-22T05:20:33.159ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57612025-01-22T05:20:33.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57622025-01-22T05:20:33.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57632025-01-22T05:20:33.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57642025-01-22T05:20:33.161ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57652025-01-22T05:20:33.163ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57662025-01-22T05:20:33.163ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57672025-01-22T05:20:33.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57682025-01-22T05:20:33.198ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57692025-01-22T05:20:33.198ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57702025-01-22T05:20:33.198ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a96a2f79-8ba8-4ef8-9c8d-3e769d47df5d", "content-length": "372", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57712025-01-22T05:20:33.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57722025-01-22T05:20:33.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57732025-01-22T05:20:33.205ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
57742025-01-22T05:20:33.205ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57752025-01-22T05:20:33.205ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffc47d77-9315-4008-a04d-959aa307bd25", "content-length": "26", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
57762025-01-22T05:20:33.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57772025-01-22T05:20:33.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
57782025-01-22T05:20:33.211ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57792025-01-22T05:20:33.240ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: af8308ab-46c4-4104-b864-f43b03f195e3, time_created: 2025-01-22T05:11:20.582572Z, time_modified: 2025-01-22T05:11:20.582572Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
57802025-01-22T05:20:33.240ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
57812025-01-22T05:20:33.240ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57822025-01-22T05:20:33.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57832025-01-22T05:20:33.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
57842025-01-22T05:20:33.362ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57852025-01-22T05:20:33.362ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3fa64994-5b4a-4604-bf86-c567f20adf25", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57862025-01-22T05:20:33.362ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57872025-01-22T05:20:33.362ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa857833-abb6-498c-9781-62060e4db38f", "content-length": "1", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
57882025-01-22T05:20:33.363ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7c2c0698-ed40-48f2-9682-88bfa3ec394a", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57892025-01-22T05:20:33.363ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57902025-01-22T05:20:33.364ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57912025-01-22T05:20:33.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57922025-01-22T05:20:33.366ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57932025-01-22T05:20:33.366ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 542.46488ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
57942025-01-22T05:20:33.373ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
57952025-01-22T05:20:33.373ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
57962025-01-22T05:20:33.398ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
57972025-01-22T05:20:33.399ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "29d86d39-4acc-47d5-b7be-ce1f0b47e809", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
57982025-01-22T05:20:33.399ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
57992025-01-22T05:20:33.400ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b1d80d89-2fc0-42d8-bd24-63eb49f0d6eb", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58002025-01-22T05:20:33.400ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58012025-01-22T05:20:33.402ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d2b96b3a-ddf9-4071-a737-7c4cdd2949c9", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58022025-01-22T05:20:33.402ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58032025-01-22T05:20:33.404ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
58042025-01-22T05:20:33.404ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 581.23386ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
58052025-01-22T05:20:33.454ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 630.83511ms iteration = 21 status = {}
58062025-01-22T05:20:33.455ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58072025-01-22T05:20:33.457ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58082025-01-22T05:20:33.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58092025-01-22T05:20:33.458ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 635.315991ms iteration = 21 status = null
58102025-01-22T05:20:33.459ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58112025-01-22T05:20:33.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
58122025-01-22T05:20:33.465ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8ec3e3e-63e3-4776-986e-6cdd01755d98", "content-length": "691", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
58132025-01-22T05:20:33.465ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
58142025-01-22T05:20:33.465ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
58152025-01-22T05:20:33.465ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
58162025-01-22T05:20:33.467ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 644.11457ms iteration = 21 status = {}
58172025-01-22T05:20:33.472ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
58182025-01-22T05:20:33.472ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58192025-01-22T05:20:33.472ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3ee7fa2a-09eb-4bb2-a4d4-5afd745f760c", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
58202025-01-22T05:20:33.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58212025-01-22T05:20:33.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58222025-01-22T05:20:33.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58232025-01-22T05:20:33.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58242025-01-22T05:20:33.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58252025-01-22T05:20:33.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58262025-01-22T05:20:33.524ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
58272025-01-22T05:20:33.524ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "f75df333-b3c3-442b-93f5-a5788b6d7828", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
58282025-01-22T05:20:33.526ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
58292025-01-22T05:20:33.526ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 702.212644ms
58302025-01-22T05:20:33.526ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 702.219144ms iteration = 3 status = {}
58312025-01-22T05:20:33.527ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58322025-01-22T05:20:33.527ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58332025-01-22T05:20:33.530ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "24e63a24-091c-47f9-86fa-859b725c394b", "date": "Wed, 22 Jan 2025 05:20:32 GMT"} })
58342025-01-22T05:20:33.532ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 708.048163ms iteration = 21 status = {}
58352025-01-22T05:20:33.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58362025-01-22T05:20:33.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58372025-01-22T05:20:33.535ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
58382025-01-22T05:20:33.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58392025-01-22T05:20:33.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58402025-01-22T05:20:33.548ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58412025-01-22T05:20:33.548ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3befcaeb-3120-4576-adef-97a6d87f7034", "content-length": "134", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
58422025-01-22T05:20:33.548ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
58432025-01-22T05:20:33.548ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
58442025-01-22T05:20:33.549ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58452025-01-22T05:20:33.549ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58462025-01-22T05:20:33.549ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58472025-01-22T05:20:33.549ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58482025-01-22T05:20:33.549ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58492025-01-22T05:20:33.549ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58502025-01-22T05:20:33.549ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58512025-01-22T05:20:33.549ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58522025-01-22T05:20:33.549ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
58532025-01-22T05:20:33.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58542025-01-22T05:20:33.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58552025-01-22T05:20:33.552ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58562025-01-22T05:20:33.552ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d1ddfbb-de25-4da0-8653-4edc1dcb61f9", "content-length": "2", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
58572025-01-22T05:20:33.552ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58582025-01-22T05:20:33.552ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "209facd8-25ec-4df6-9fce-28fb6e488a1e", "content-length": "51", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
58592025-01-22T05:20:33.552ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
58602025-01-22T05:20:33.552ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58612025-01-22T05:20:33.644ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "a736d4cd-c112-4ef9-b42d-658b66ab9f2c", "content-length": "30796", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
58622025-01-22T05:20:33.646ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
58632025-01-22T05:20:33.646ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
58642025-01-22T05:20:33.646ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
58652025-01-22T05:20:33.648ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58662025-01-22T05:20:33.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58672025-01-22T05:20:33.650ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58682025-01-22T05:20:33.652ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
58692025-01-22T05:20:33.652ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58702025-01-22T05:20:33.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58712025-01-22T05:20:33.667ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c233a516-c782-4df8-bad0-f1d4c9402bd4", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
58722025-01-22T05:20:33.667ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
58732025-01-22T05:20:33.667ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58742025-01-22T05:20:33.667ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "214014fc-34ad-4970-9d16-b6c4bd821a20", "content-length": "682", "date": "Wed, 22 Jan 2025 05:20:33 GMT"} })
58752025-01-22T05:20:33.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58762025-01-22T05:20:33.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58772025-01-22T05:20:33.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58782025-01-22T05:20:33.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58792025-01-22T05:20:33.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58802025-01-22T05:20:33.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58812025-01-22T05:20:33.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58822025-01-22T05:20:33.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58832025-01-22T05:20:33.684ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 861.0888ms iteration = 21 status = {}
58842025-01-22T05:20:33.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 47d39b0d-69d0-4f06-b520-2c7ec634529b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
58852025-01-22T05:20:33.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 47d39b0d-69d0-4f06-b520-2c7ec634529b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
58862025-01-22T05:20:33.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 47d39b0d-69d0-4f06-b520-2c7ec634529b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
58872025-01-22T05:20:33.825ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = e3c609aa-dc35-4fe5-96be-01529291a285 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
58882025-01-22T05:20:33.825ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = e3c609aa-dc35-4fe5-96be-01529291a285 time_started = 2025-01-22 05:20:33.071472 UTC
58892025-01-22T05:20:33.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
58902025-01-22T05:20:33.825ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.001669734s iteration = 3 status = {"collection_id":"e3c609aa-dc35-4fe5-96be-01529291a285","time_done":"2025-01-22 05:20:33.646975 UTC","time_started":"2025-01-22 05:20:33.071472 UTC"}
58912025-01-22T05:20:33.825ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
58922025-01-22T05:20:33.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58932025-01-22T05:20:33.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58942025-01-22T05:20:33.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58952025-01-22T05:20:33.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58962025-01-22T05:20:33.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58972025-01-22T05:20:33.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58982025-01-22T05:20:33.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58992025-01-22T05:20:33.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59002025-01-22T05:20:33.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59012025-01-22T05:20:33.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
59022025-01-22T05:20:33.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59032025-01-22T05:20:33.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59042025-01-22T05:20:33.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59052025-01-22T05:20:33.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59062025-01-22T05:20:33.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59072025-01-22T05:20:33.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59082025-01-22T05:20:33.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59092025-01-22T05:20:33.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59102025-01-22T05:20:33.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59112025-01-22T05:20:33.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59122025-01-22T05:20:33.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59132025-01-22T05:20:33.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59142025-01-22T05:20:33.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59152025-01-22T05:20:33.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
59162025-01-22T05:20:33.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59172025-01-22T05:20:33.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59182025-01-22T05:20:33.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59192025-01-22T05:20:33.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
59202025-01-22T05:20:33.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59212025-01-22T05:20:33.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59222025-01-22T05:20:33.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 49.793824ms iteration = 6 status = {}
59232025-01-22T05:20:33.931ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 106.266084ms iteration = 24 status = {"physical_disks_added":0}
59242025-01-22T05:20:33.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 142e60a5-ae7b-4fd5-9896-4ef72dade7d2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
59252025-01-22T05:20:33.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 142e60a5-ae7b-4fd5-9896-4ef72dade7d2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
59262025-01-22T05:20:33.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 142e60a5-ae7b-4fd5-9896-4ef72dade7d2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
59272025-01-22T05:20:34.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e2e8b92a-a9e3-4d02-9427-bb142f60f854 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59282025-01-22T05:20:34.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e2e8b92a-a9e3-4d02-9427-bb142f60f854 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59292025-01-22T05:20:34.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e2e8b92a-a9e3-4d02-9427-bb142f60f854 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59302025-01-22T05:20:35.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a136e28-c381-495b-a8ea-a27d8bc2f3da roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59312025-01-22T05:20:35.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a136e28-c381-495b-a8ea-a27d8bc2f3da resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59322025-01-22T05:20:35.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a136e28-c381-495b-a8ea-a27d8bc2f3da response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59332025-01-22T05:20:35.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 532 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = a3f973b7-1fc0-4e02-80fd-20627cb60245 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
59342025-01-22T05:20:36.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5e3519a0-6dba-4843-997b-62ce2e1c23f5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59352025-01-22T05:20:36.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5e3519a0-6dba-4843-997b-62ce2e1c23f5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59362025-01-22T05:20:36.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5e3519a0-6dba-4843-997b-62ce2e1c23f5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59372025-01-22T05:20:37.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 81774573-9819-4b45-a0e3-fa99cbc26dc1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59382025-01-22T05:20:37.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 81774573-9819-4b45-a0e3-fa99cbc26dc1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59392025-01-22T05:20:37.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 81774573-9819-4b45-a0e3-fa99cbc26dc1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59402025-01-22T05:20:38.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 54bdb13a-3e7d-46de-afec-04be525f8ddb roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59412025-01-22T05:20:38.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 54bdb13a-3e7d-46de-afec-04be525f8ddb resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59422025-01-22T05:20:38.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 54bdb13a-3e7d-46de-afec-04be525f8ddb response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59432025-01-22T05:20:39.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8868b34d-a336-4da1-acfb-1e60db96d339 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59442025-01-22T05:20:39.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8868b34d-a336-4da1-acfb-1e60db96d339 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59452025-01-22T05:20:39.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8868b34d-a336-4da1-acfb-1e60db96d339 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59462025-01-22T05:20:40.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3fecebb1-c6b8-439e-bd32-2e149e73c0ad roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59472025-01-22T05:20:40.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3fecebb1-c6b8-439e-bd32-2e149e73c0ad resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59482025-01-22T05:20:40.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3fecebb1-c6b8-439e-bd32-2e149e73c0ad response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59492025-01-22T05:20:41.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bc03cd05-efa9-40ce-b64a-c09a302ae5e6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59502025-01-22T05:20:41.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bc03cd05-efa9-40ce-b64a-c09a302ae5e6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59512025-01-22T05:20:41.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bc03cd05-efa9-40ce-b64a-c09a302ae5e6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59522025-01-22T05:20:42.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
59532025-01-22T05:20:42.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59542025-01-22T05:20:42.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59552025-01-22T05:20:42.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
59562025-01-22T05:20:42.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59572025-01-22T05:20:42.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59582025-01-22T05:20:42.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59592025-01-22T05:20:42.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59602025-01-22T05:20:42.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59612025-01-22T05:20:42.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59622025-01-22T05:20:42.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59632025-01-22T05:20:42.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59642025-01-22T05:20:42.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59652025-01-22T05:20:42.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
59662025-01-22T05:20:42.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59672025-01-22T05:20:42.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59682025-01-22T05:20:42.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
59692025-01-22T05:20:42.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.415446ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
59702025-01-22T05:20:42.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59712025-01-22T05:20:42.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59722025-01-22T05:20:42.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.699105ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59732025-01-22T05:20:42.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dbf216e9-1420-42f2-8479-6f894a48272a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59742025-01-22T05:20:42.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dbf216e9-1420-42f2-8479-6f894a48272a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59752025-01-22T05:20:42.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dbf216e9-1420-42f2-8479-6f894a48272a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59762025-01-22T05:20:43.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6bab2c99-c3ed-4d81-9766-7a8a9a7436b0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59772025-01-22T05:20:43.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6bab2c99-c3ed-4d81-9766-7a8a9a7436b0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59782025-01-22T05:20:43.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6bab2c99-c3ed-4d81-9766-7a8a9a7436b0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59792025-01-22T05:20:44.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f020cb5-0e96-4806-90d6-d3b3831c0273 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59802025-01-22T05:20:44.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f020cb5-0e96-4806-90d6-d3b3831c0273 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59812025-01-22T05:20:44.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f020cb5-0e96-4806-90d6-d3b3831c0273 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59822025-01-22T05:20:45.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 775 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 8d7d4fc3-c392-48f0-9819-5247b3fa75da response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
59832025-01-22T05:20:46.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9fadfaa7-d30b-4afa-8a71-7e1c9dde3444 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59842025-01-22T05:20:46.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9fadfaa7-d30b-4afa-8a71-7e1c9dde3444 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59852025-01-22T05:20:46.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9fadfaa7-d30b-4afa-8a71-7e1c9dde3444 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59862025-01-22T05:20:47.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e9ebe564-5fad-4c44-8992-9698ec85842b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59872025-01-22T05:20:47.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e9ebe564-5fad-4c44-8992-9698ec85842b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59882025-01-22T05:20:47.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e9ebe564-5fad-4c44-8992-9698ec85842b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59892025-01-22T05:20:48.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5db3bab-e6b1-421c-830a-e5a667ee003e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59902025-01-22T05:20:48.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5db3bab-e6b1-421c-830a-e5a667ee003e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59912025-01-22T05:20:48.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5db3bab-e6b1-421c-830a-e5a667ee003e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59922025-01-22T05:20:49.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f5e35ef9-3335-4d12-ae1a-b20b4a571121 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59932025-01-22T05:20:49.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f5e35ef9-3335-4d12-ae1a-b20b4a571121 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59942025-01-22T05:20:49.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f5e35ef9-3335-4d12-ae1a-b20b4a571121 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59952025-01-22T05:20:50.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 145c2d04-70f3-48f2-924a-38385a5cf9d4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59962025-01-22T05:20:50.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 145c2d04-70f3-48f2-924a-38385a5cf9d4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59972025-01-22T05:20:50.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 145c2d04-70f3-48f2-924a-38385a5cf9d4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59982025-01-22T05:20:51.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 14c45eda-b0d2-4e27-9a77-90ada3171eb8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
59992025-01-22T05:20:51.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 14c45eda-b0d2-4e27-9a77-90ada3171eb8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60002025-01-22T05:20:51.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 14c45eda-b0d2-4e27-9a77-90ada3171eb8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60012025-01-22T05:20:52.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4c71b1ac-3d77-44e3-8f47-2447361ff77f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60022025-01-22T05:20:52.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4c71b1ac-3d77-44e3-8f47-2447361ff77f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60032025-01-22T05:20:52.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4c71b1ac-3d77-44e3-8f47-2447361ff77f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60042025-01-22T05:20:52.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
60052025-01-22T05:20:52.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60062025-01-22T05:20:52.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60072025-01-22T05:20:52.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
60082025-01-22T05:20:52.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60092025-01-22T05:20:52.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60102025-01-22T05:20:52.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60112025-01-22T05:20:52.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60122025-01-22T05:20:52.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60132025-01-22T05:20:52.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60142025-01-22T05:20:52.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60152025-01-22T05:20:52.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60162025-01-22T05:20:52.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60172025-01-22T05:20:52.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
60182025-01-22T05:20:52.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60192025-01-22T05:20:52.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60202025-01-22T05:20:52.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
60212025-01-22T05:20:52.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.232723ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
60222025-01-22T05:20:52.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60232025-01-22T05:20:52.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60242025-01-22T05:20:52.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.324338ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60252025-01-22T05:20:53.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 07aedf2c-6075-4b8a-b764-6ed104aaaa03 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60262025-01-22T05:20:53.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 07aedf2c-6075-4b8a-b764-6ed104aaaa03 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60272025-01-22T05:20:53.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 07aedf2c-6075-4b8a-b764-6ed104aaaa03 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60282025-01-22T05:20:54.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8314fb2e-7528-444f-a2ce-4b3326d92f50 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60292025-01-22T05:20:54.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8314fb2e-7528-444f-a2ce-4b3326d92f50 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60302025-01-22T05:20:54.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8314fb2e-7528-444f-a2ce-4b3326d92f50 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60312025-01-22T05:20:55.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cf6f38d5-9313-4608-8698-f3d8b70f76f2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60322025-01-22T05:20:55.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cf6f38d5-9313-4608-8698-f3d8b70f76f2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60332025-01-22T05:20:55.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cf6f38d5-9313-4608-8698-f3d8b70f76f2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60342025-01-22T05:20:55.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 882 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = dfdbd08d-cffd-426a-b637-dbb986a7b57f response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
60352025-01-22T05:20:56.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a736502b-3235-464c-9a2d-799b5aba53f6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60362025-01-22T05:20:56.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a736502b-3235-464c-9a2d-799b5aba53f6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60372025-01-22T05:20:56.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a736502b-3235-464c-9a2d-799b5aba53f6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60382025-01-22T05:20:57.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e32c0303-4005-4098-8e3c-772b54443f3d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60392025-01-22T05:20:57.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e32c0303-4005-4098-8e3c-772b54443f3d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60402025-01-22T05:20:57.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e32c0303-4005-4098-8e3c-772b54443f3d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60412025-01-22T05:20:58.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8004ac76-1442-4d32-bdc7-5bdff6122a48 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60422025-01-22T05:20:58.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8004ac76-1442-4d32-bdc7-5bdff6122a48 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60432025-01-22T05:20:58.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8004ac76-1442-4d32-bdc7-5bdff6122a48 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60442025-01-22T05:20:59.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1ad17b8b-bbf9-47b1-ae54-d78a203c341a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60452025-01-22T05:20:59.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1ad17b8b-bbf9-47b1-ae54-d78a203c341a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60462025-01-22T05:20:59.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1ad17b8b-bbf9-47b1-ae54-d78a203c341a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60472025-01-22T05:21:00.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 456738b2-fa90-403c-9db9-56458085c3c6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60482025-01-22T05:21:00.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 456738b2-fa90-403c-9db9-56458085c3c6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60492025-01-22T05:21:00.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 456738b2-fa90-403c-9db9-56458085c3c6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60502025-01-22T05:21:01.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 646c8571-7ae2-45a6-ad98-06b947cd8d45 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60512025-01-22T05:21:01.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 646c8571-7ae2-45a6-ad98-06b947cd8d45 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60522025-01-22T05:21:01.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 646c8571-7ae2-45a6-ad98-06b947cd8d45 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60532025-01-22T05:21:02.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 95a245f3-0fbf-4c8b-8edd-28f670c6ee6d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60542025-01-22T05:21:02.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 95a245f3-0fbf-4c8b-8edd-28f670c6ee6d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60552025-01-22T05:21:02.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 95a245f3-0fbf-4c8b-8edd-28f670c6ee6d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
60562025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
60572025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
60582025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
60592025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60602025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
60612025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60622025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60632025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
60642025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
60652025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60662025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60672025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
60682025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
60692025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60702025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60712025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
60722025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60732025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
60742025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60752025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60762025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60772025-01-22T05:21:02.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60782025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60792025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60802025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60812025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60822025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60832025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60842025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
60852025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
60862025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60872025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60882025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
60892025-01-22T05:21:02.824ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60902025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60912025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
60922025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60932025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60942025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60952025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60962025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60972025-01-22T05:21:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60982025-01-22T05:21:02.827ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11445, tv_nsec: 174783936 } })
60992025-01-22T05:21:02.827ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.902609ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61002025-01-22T05:21:02.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
61012025-01-22T05:21:02.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61022025-01-22T05:21:02.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61032025-01-22T05:21:02.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11445, tv_nsec: 176733115 } })
61042025-01-22T05:21:02.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
61052025-01-22T05:21:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61062025-01-22T05:21:02.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61072025-01-22T05:21:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61082025-01-22T05:21:02.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61092025-01-22T05:21:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61102025-01-22T05:21:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61112025-01-22T05:21:02.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61122025-01-22T05:21:02.833ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61132025-01-22T05:21:02.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61142025-01-22T05:21:02.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61152025-01-22T05:21:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61162025-01-22T05:21:02.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61172025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61182025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61192025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61202025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61212025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61222025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61232025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61242025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61252025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61262025-01-22T05:21:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61272025-01-22T05:21:02.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61282025-01-22T05:21:02.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61292025-01-22T05:21:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61302025-01-22T05:21:02.840ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61312025-01-22T05:21:02.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61322025-01-22T05:21:02.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61332025-01-22T05:21:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61342025-01-22T05:21:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61352025-01-22T05:21:02.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61362025-01-22T05:21:02.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61372025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
61382025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
61392025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61402025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61412025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
61422025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61432025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
61442025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61452025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61462025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61472025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61482025-01-22T05:21:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61492025-01-22T05:21:02.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11445, tv_nsec: 193855334 } })
61502025-01-22T05:21:02.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
61512025-01-22T05:21:02.849ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61522025-01-22T05:21:02.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61532025-01-22T05:21:02.851ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61542025-01-22T05:21:02.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61552025-01-22T05:21:02.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.990943ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
61562025-01-22T05:21:02.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61572025-01-22T05:21:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61582025-01-22T05:21:02.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61592025-01-22T05:21:02.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61602025-01-22T05:21:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61612025-01-22T05:21:02.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61622025-01-22T05:21:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61632025-01-22T05:21:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61642025-01-22T05:21:02.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.572442ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61652025-01-22T05:21:02.879ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61662025-01-22T05:21:02.879ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61672025-01-22T05:21:02.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61682025-01-22T05:21:02.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61692025-01-22T05:21:02.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61702025-01-22T05:21:02.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61712025-01-22T05:21:02.881ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61722025-01-22T05:21:02.881ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61732025-01-22T05:21:02.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61742025-01-22T05:21:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61752025-01-22T05:21:02.883ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61762025-01-22T05:21:02.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61772025-01-22T05:21:02.883ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61782025-01-22T05:21:02.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61792025-01-22T05:21:02.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61802025-01-22T05:21:02.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61812025-01-22T05:21:02.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61822025-01-22T05:21:02.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61832025-01-22T05:21:02.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
61842025-01-22T05:21:02.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61852025-01-22T05:21:02.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61862025-01-22T05:21:02.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61872025-01-22T05:21:02.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61882025-01-22T05:21:02.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61892025-01-22T05:21:02.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61902025-01-22T05:21:02.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61912025-01-22T05:21:02.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.497606ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61922025-01-22T05:21:02.895ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61932025-01-22T05:21:02.895ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.922515ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61942025-01-22T05:21:02.896ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
61952025-01-22T05:21:02.896ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 72.556868ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
61962025-01-22T05:21:02.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.884787ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
61972025-01-22T05:21:02.901ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
61982025-01-22T05:21:02.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.801725ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
61992025-01-22T05:21:02.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
62002025-01-22T05:21:02.905ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62012025-01-22T05:21:02.905ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ed87d32-04fd-40bf-8295-ae1331a27b8f", "content-length": "26", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62022025-01-22T05:21:02.905ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62032025-01-22T05:21:02.908ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62042025-01-22T05:21:02.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62052025-01-22T05:21:02.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
62062025-01-22T05:21:02.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62072025-01-22T05:21:02.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62082025-01-22T05:21:02.918ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.482685ms iteration = 22 status = 0
62092025-01-22T05:21:02.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 73.385775ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
62102025-01-22T05:21:02.922ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
62112025-01-22T05:21:02.922ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62122025-01-22T05:21:02.922ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fc8dd1b-a886-4929-a969-e7870bc21c25", "content-length": "26", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62132025-01-22T05:21:02.922ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62142025-01-22T05:21:02.923ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62152025-01-22T05:21:02.923ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62162025-01-22T05:21:02.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62172025-01-22T05:21:02.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62182025-01-22T05:21:02.924ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62192025-01-22T05:21:02.924ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.160012ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62202025-01-22T05:21:02.945ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
62212025-01-22T05:21:02.945ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62222025-01-22T05:21:02.945ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "960dc062-ee6b-4bae-8830-517de18f4f95", "content-length": "26", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62232025-01-22T05:21:02.945ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62242025-01-22T05:21:02.947ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
62252025-01-22T05:21:02.957ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62262025-01-22T05:21:02.957ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62272025-01-22T05:21:02.957ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.859876ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62282025-01-22T05:21:02.977ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62292025-01-22T05:21:02.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62302025-01-22T05:21:02.992ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 169.36868ms iteration = 25 status = {"physical_disks_added":0}
62312025-01-22T05:21:03.020ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62322025-01-22T05:21:03.020ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb660909-613c-437c-b02e-b27136687638", "content-length": "1", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62332025-01-22T05:21:03.021ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62342025-01-22T05:21:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62352025-01-22T05:21:03.035ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 212.336915ms iteration = 22 status = {}
62362025-01-22T05:21:03.040ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62372025-01-22T05:21:03.040ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62382025-01-22T05:21:03.040ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8367c2d-e7d0-4e33-9fd8-2d757feddb58", "content-length": "372", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62392025-01-22T05:21:03.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62402025-01-22T05:21:03.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62412025-01-22T05:21:03.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62422025-01-22T05:21:03.043ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.515262ms iteration = 22 status = null
62432025-01-22T05:21:03.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62442025-01-22T05:21:03.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62452025-01-22T05:21:03.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62462025-01-22T05:21:03.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62472025-01-22T05:21:03.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62482025-01-22T05:21:03.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62492025-01-22T05:21:03.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62502025-01-22T05:21:03.088ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62512025-01-22T05:21:03.088ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62522025-01-22T05:21:03.088ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d368f2a7-8712-408e-bdcb-69a77cb9e14d", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62532025-01-22T05:21:03.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62542025-01-22T05:21:03.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62552025-01-22T05:21:03.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62562025-01-22T05:21:03.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62572025-01-22T05:21:03.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62582025-01-22T05:21:03.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62592025-01-22T05:21:03.096ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62602025-01-22T05:21:03.096ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62612025-01-22T05:21:03.096ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cf140114-8fcd-4c67-a6d8-2599789e1d0a", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62622025-01-22T05:21:03.098ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.704886ms iteration = 22 status = {}
62632025-01-22T05:21:03.100ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62642025-01-22T05:21:03.100ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "27a0712c-606f-4db5-926c-6a0d53a8dadf", "content-length": "691", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62652025-01-22T05:21:03.100ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
62662025-01-22T05:21:03.100ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
62672025-01-22T05:21:03.100ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
62682025-01-22T05:21:03.101ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 278.182677ms iteration = 22 status = {}
62692025-01-22T05:21:03.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62702025-01-22T05:21:03.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62712025-01-22T05:21:03.129ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
62722025-01-22T05:21:03.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62732025-01-22T05:21:03.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62742025-01-22T05:21:03.138ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62752025-01-22T05:21:03.138ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdd90e1e-4c66-40de-9ff4-977713124d75", "content-length": "134", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62762025-01-22T05:21:03.138ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62772025-01-22T05:21:03.138ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
62782025-01-22T05:21:03.138ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62792025-01-22T05:21:03.138ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62802025-01-22T05:21:03.138ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62812025-01-22T05:21:03.138ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62822025-01-22T05:21:03.138ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62832025-01-22T05:21:03.138ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62842025-01-22T05:21:03.139ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62852025-01-22T05:21:03.139ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62862025-01-22T05:21:03.139ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
62872025-01-22T05:21:03.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62882025-01-22T05:21:03.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62892025-01-22T05:21:03.141ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62902025-01-22T05:21:03.141ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3b09d62-0073-4315-93c4-8fae5405f3d6", "content-length": "2", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62912025-01-22T05:21:03.141ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62922025-01-22T05:21:03.141ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2330d833-b660-47ef-a8ae-257197cf6b3d", "content-length": "51", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62932025-01-22T05:21:03.141ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
62942025-01-22T05:21:03.141ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62952025-01-22T05:21:03.236ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "24371095-599e-499d-b3f8-8157c67044e8", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62962025-01-22T05:21:03.236ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
62972025-01-22T05:21:03.236ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62982025-01-22T05:21:03.236ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "78ba8f9a-76a2-4f92-8080-f94ee0e48e09", "content-length": "682", "date": "Wed, 22 Jan 2025 05:21:02 GMT"} })
62992025-01-22T05:21:03.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63002025-01-22T05:21:03.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63012025-01-22T05:21:03.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63022025-01-22T05:21:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63032025-01-22T05:21:03.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63042025-01-22T05:21:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63052025-01-22T05:21:03.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63062025-01-22T05:21:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63072025-01-22T05:21:03.253ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 429.684863ms iteration = 22 status = {}
63082025-01-22T05:21:03.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ca1a44fd-8d4d-4a4d-b76b-c6e43df1b99f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63092025-01-22T05:21:03.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ca1a44fd-8d4d-4a4d-b76b-c6e43df1b99f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63102025-01-22T05:21:03.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ca1a44fd-8d4d-4a4d-b76b-c6e43df1b99f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63112025-01-22T05:21:03.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = ecc9807c-0fa0-4a14-b791-6b86e157be26 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
63122025-01-22T05:21:03.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = ecc9807c-0fa0-4a14-b791-6b86e157be26 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
63132025-01-22T05:21:03.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = ecc9807c-0fa0-4a14-b791-6b86e157be26 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
63142025-01-22T05:21:04.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 900731d5-47a9-49cc-98fb-452d722cb697 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63152025-01-22T05:21:04.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 900731d5-47a9-49cc-98fb-452d722cb697 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63162025-01-22T05:21:04.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 900731d5-47a9-49cc-98fb-452d722cb697 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63172025-01-22T05:21:05.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0679c5ea-b852-46e4-8fa8-9b481c46fc28 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63182025-01-22T05:21:05.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0679c5ea-b852-46e4-8fa8-9b481c46fc28 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63192025-01-22T05:21:05.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0679c5ea-b852-46e4-8fa8-9b481c46fc28 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63202025-01-22T05:21:05.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 680 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 64ffda8d-9a73-423b-987e-aeb3443b22ad response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
63212025-01-22T05:21:06.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 135828c9-f1e0-4008-a7f0-44eb13315dc0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63222025-01-22T05:21:06.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 135828c9-f1e0-4008-a7f0-44eb13315dc0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63232025-01-22T05:21:06.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 135828c9-f1e0-4008-a7f0-44eb13315dc0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63242025-01-22T05:21:07.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 57dbdbd3-1076-41e1-9b96-506f2594ddac roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63252025-01-22T05:21:07.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 57dbdbd3-1076-41e1-9b96-506f2594ddac resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63262025-01-22T05:21:07.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 57dbdbd3-1076-41e1-9b96-506f2594ddac response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63272025-01-22T05:21:08.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 631e09f7-a536-4750-935c-d61359d1d0e6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63282025-01-22T05:21:08.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 631e09f7-a536-4750-935c-d61359d1d0e6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63292025-01-22T05:21:08.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 631e09f7-a536-4750-935c-d61359d1d0e6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63302025-01-22T05:21:09.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 19184319-a5ed-4a0f-baf9-c3bbbd954db2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63312025-01-22T05:21:09.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 19184319-a5ed-4a0f-baf9-c3bbbd954db2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63322025-01-22T05:21:09.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 19184319-a5ed-4a0f-baf9-c3bbbd954db2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63332025-01-22T05:21:10.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3975ca15-8278-48fe-ba9a-0e073355f2a6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63342025-01-22T05:21:10.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3975ca15-8278-48fe-ba9a-0e073355f2a6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63352025-01-22T05:21:10.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3975ca15-8278-48fe-ba9a-0e073355f2a6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63362025-01-22T05:21:11.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f1c6079-199a-4d06-b846-f272b57764e1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63372025-01-22T05:21:11.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f1c6079-199a-4d06-b846-f272b57764e1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63382025-01-22T05:21:11.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f1c6079-199a-4d06-b846-f272b57764e1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63392025-01-22T05:21:12.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b5b9367a-2222-4aee-bd79-a1a9d7be3697 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63402025-01-22T05:21:12.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b5b9367a-2222-4aee-bd79-a1a9d7be3697 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63412025-01-22T05:21:12.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b5b9367a-2222-4aee-bd79-a1a9d7be3697 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63422025-01-22T05:21:12.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
63432025-01-22T05:21:12.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63442025-01-22T05:21:12.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63452025-01-22T05:21:12.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
63462025-01-22T05:21:12.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63472025-01-22T05:21:12.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63482025-01-22T05:21:12.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63492025-01-22T05:21:12.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63502025-01-22T05:21:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63512025-01-22T05:21:12.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63522025-01-22T05:21:12.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63532025-01-22T05:21:12.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.45958ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63542025-01-22T05:21:12.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63552025-01-22T05:21:12.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63562025-01-22T05:21:12.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63572025-01-22T05:21:12.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63582025-01-22T05:21:12.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
63592025-01-22T05:21:12.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63602025-01-22T05:21:12.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63612025-01-22T05:21:12.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
63622025-01-22T05:21:12.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.394855ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
63632025-01-22T05:21:13.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 00a2568e-edbc-4735-a173-2009c3fb86f6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63642025-01-22T05:21:13.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 00a2568e-edbc-4735-a173-2009c3fb86f6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63652025-01-22T05:21:13.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 00a2568e-edbc-4735-a173-2009c3fb86f6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63662025-01-22T05:21:14.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 35b56e32-13e1-4678-8877-a88b2f0e63e1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63672025-01-22T05:21:14.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 35b56e32-13e1-4678-8877-a88b2f0e63e1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63682025-01-22T05:21:14.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 35b56e32-13e1-4678-8877-a88b2f0e63e1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63692025-01-22T05:21:15.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2cb4c205-1bdd-4309-ad4e-d24434fd5db2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63702025-01-22T05:21:15.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2cb4c205-1bdd-4309-ad4e-d24434fd5db2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63712025-01-22T05:21:15.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2cb4c205-1bdd-4309-ad4e-d24434fd5db2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63722025-01-22T05:21:15.974ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:57662
63732025-01-22T05:21:15.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 1b792973-8afe-4323-b1da-ffe95470055c roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
63742025-01-22T05:21:15.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 1b792973-8afe-4323-b1da-ffe95470055c resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
63752025-01-22T05:21:15.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 1b792973-8afe-4323-b1da-ffe95470055c response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
63762025-01-22T05:21:15.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = b0a0d1da-1c97-4eae-8bd2-f7b675cb6ac7 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
63772025-01-22T05:21:15.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = b0a0d1da-1c97-4eae-8bd2-f7b675cb6ac7 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
63782025-01-22T05:21:15.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = b0a0d1da-1c97-4eae-8bd2-f7b675cb6ac7 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
63792025-01-22T05:21:15.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 419 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = aa191cf3-a843-488d-b578-c6239d7037f0 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
63802025-01-22T05:21:16.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9d540bdd-a25b-42dc-af83-30875118c6ec roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63812025-01-22T05:21:16.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9d540bdd-a25b-42dc-af83-30875118c6ec resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63822025-01-22T05:21:16.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9d540bdd-a25b-42dc-af83-30875118c6ec response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63832025-01-22T05:21:17.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = da7b9c25-bf08-4fc7-9ed6-f2e1f1442131 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63842025-01-22T05:21:17.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = da7b9c25-bf08-4fc7-9ed6-f2e1f1442131 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63852025-01-22T05:21:17.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = da7b9c25-bf08-4fc7-9ed6-f2e1f1442131 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63862025-01-22T05:21:18.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 497ac275-0c16-4700-8eee-f9391003d27f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63872025-01-22T05:21:18.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 497ac275-0c16-4700-8eee-f9391003d27f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63882025-01-22T05:21:18.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 497ac275-0c16-4700-8eee-f9391003d27f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63892025-01-22T05:21:19.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ea9ce5bb-87a7-4be6-a098-149a85575808 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63902025-01-22T05:21:19.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ea9ce5bb-87a7-4be6-a098-149a85575808 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63912025-01-22T05:21:19.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ea9ce5bb-87a7-4be6-a098-149a85575808 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63922025-01-22T05:21:20.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c1e7333e-ce36-4816-b446-b7aac13b1edf roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63932025-01-22T05:21:20.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c1e7333e-ce36-4816-b446-b7aac13b1edf resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63942025-01-22T05:21:20.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c1e7333e-ce36-4816-b446-b7aac13b1edf response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63952025-01-22T05:21:21.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5c65c43d-d463-4199-8589-58dbc241f082 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63962025-01-22T05:21:21.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5c65c43d-d463-4199-8589-58dbc241f082 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63972025-01-22T05:21:21.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5c65c43d-d463-4199-8589-58dbc241f082 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63982025-01-22T05:21:22.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f76fcea6-a382-4c59-9222-9ab5cafe990d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
63992025-01-22T05:21:22.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f76fcea6-a382-4c59-9222-9ab5cafe990d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64002025-01-22T05:21:22.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f76fcea6-a382-4c59-9222-9ab5cafe990d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64012025-01-22T05:21:22.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
64022025-01-22T05:21:22.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64032025-01-22T05:21:22.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64042025-01-22T05:21:22.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
64052025-01-22T05:21:22.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64062025-01-22T05:21:22.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64072025-01-22T05:21:22.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64082025-01-22T05:21:22.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64092025-01-22T05:21:22.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64102025-01-22T05:21:22.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64112025-01-22T05:21:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64122025-01-22T05:21:22.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64132025-01-22T05:21:22.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64142025-01-22T05:21:22.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
64152025-01-22T05:21:22.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64162025-01-22T05:21:22.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64172025-01-22T05:21:22.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
64182025-01-22T05:21:22.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.488686ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
64192025-01-22T05:21:22.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64202025-01-22T05:21:22.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64212025-01-22T05:21:22.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.248416ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64222025-01-22T05:21:23.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b73858b5-ce35-410b-8d03-a23cfaed77da roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64232025-01-22T05:21:23.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b73858b5-ce35-410b-8d03-a23cfaed77da resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64242025-01-22T05:21:23.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b73858b5-ce35-410b-8d03-a23cfaed77da response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64252025-01-22T05:21:24.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 63a7eb7d-258f-4a95-be7e-1ef9c4474307 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64262025-01-22T05:21:24.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 63a7eb7d-258f-4a95-be7e-1ef9c4474307 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64272025-01-22T05:21:24.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 63a7eb7d-258f-4a95-be7e-1ef9c4474307 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64282025-01-22T05:21:25.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 48834c90-84e7-4de6-b8f4-c9bb0a6caa18 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64292025-01-22T05:21:25.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 48834c90-84e7-4de6-b8f4-c9bb0a6caa18 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64302025-01-22T05:21:25.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 48834c90-84e7-4de6-b8f4-c9bb0a6caa18 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64312025-01-22T05:21:25.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 823 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 5659dcc9-0443-412c-ac82-8bca247ac809 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
64322025-01-22T05:21:26.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 544da26a-26d3-4291-b5a4-642c3845da6a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64332025-01-22T05:21:26.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 544da26a-26d3-4291-b5a4-642c3845da6a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64342025-01-22T05:21:26.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 544da26a-26d3-4291-b5a4-642c3845da6a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64352025-01-22T05:21:27.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bd38097a-afd0-4f59-b08f-3598e8d06ce6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64362025-01-22T05:21:27.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bd38097a-afd0-4f59-b08f-3598e8d06ce6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64372025-01-22T05:21:27.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bd38097a-afd0-4f59-b08f-3598e8d06ce6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64382025-01-22T05:21:28.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cdb25e09-8f6f-4922-8426-81a59dd48c0b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64392025-01-22T05:21:28.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cdb25e09-8f6f-4922-8426-81a59dd48c0b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64402025-01-22T05:21:28.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cdb25e09-8f6f-4922-8426-81a59dd48c0b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64412025-01-22T05:21:29.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a908806e-4581-470d-9b8b-708af06d98f2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64422025-01-22T05:21:29.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a908806e-4581-470d-9b8b-708af06d98f2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64432025-01-22T05:21:29.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a908806e-4581-470d-9b8b-708af06d98f2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64442025-01-22T05:21:30.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 86654777-4715-46f8-8e19-104f88777895 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
64452025-01-22T05:21:30.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 86654777-4715-46f8-8e19-104f88777895 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
64462025-01-22T05:21:30.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 86654777-4715-46f8-8e19-104f88777895 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
64472025-01-22T05:21:30.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 8073d4d5-2471-425e-af72-d184e2df9e14 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
64482025-01-22T05:21:30.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 8073d4d5-2471-425e-af72-d184e2df9e14 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
64492025-01-22T05:21:30.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 8073d4d5-2471-425e-af72-d184e2df9e14 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
64502025-01-22T05:21:30.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3f793ef1-ba02-44bc-8c1b-33fe8fd965e3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64512025-01-22T05:21:30.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3f793ef1-ba02-44bc-8c1b-33fe8fd965e3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64522025-01-22T05:21:30.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3f793ef1-ba02-44bc-8c1b-33fe8fd965e3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64532025-01-22T05:21:32.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 60dd9f64-534e-4a8e-8247-24a0b11e7c1b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64542025-01-22T05:21:32.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 60dd9f64-534e-4a8e-8247-24a0b11e7c1b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64552025-01-22T05:21:32.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 60dd9f64-534e-4a8e-8247-24a0b11e7c1b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
64562025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
64572025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
64582025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64592025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
64602025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64612025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
64622025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
64632025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64642025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
64652025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
64662025-01-22T05:21:32.823ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:11:32.823469689 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
64672025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
64682025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64692025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
64702025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
64712025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64722025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
64732025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64742025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
64752025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
64762025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64772025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
64782025-01-22T05:21:32.823ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
64792025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.531\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
64802025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
64812025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
64822025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
64832025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64842025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
64852025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64862025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64872025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
64882025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64892025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
64902025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
64912025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64922025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
64932025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
64942025-01-22T05:21:32.823ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
64952025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64962025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64972025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64982025-01-22T05:21:32.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64992025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65002025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65012025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65022025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65032025-01-22T05:21:32.824ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11475, tv_nsec: 171322675 } })
65042025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65052025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65062025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65072025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65082025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65092025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65102025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65112025-01-22T05:21:32.824ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11475, tv_nsec: 171418637 } })
65122025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
65132025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
65142025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
65152025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65162025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65172025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65182025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65192025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
65202025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65212025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
65222025-01-22T05:21:32.824ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65232025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65242025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
65252025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
65262025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65272025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65282025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65292025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65302025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65312025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
65322025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 988.93\u{b5}s iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
65332025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65342025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
65352025-01-22T05:21:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.354907ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
65362025-01-22T05:21:32.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65372025-01-22T05:21:32.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65382025-01-22T05:21:32.827ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65392025-01-22T05:21:32.827ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:11:32.823469689 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
65402025-01-22T05:21:32.827ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.040243ms iteration = 12 status = {"expiration":"2025-01-22T05:11:32.823469689Z","pruned":[]}
65412025-01-22T05:21:32.827ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.052783ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65422025-01-22T05:21:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65432025-01-22T05:21:32.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65442025-01-22T05:21:32.828ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11475, tv_nsec: 175965989 } })
65452025-01-22T05:21:32.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65462025-01-22T05:21:32.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
65472025-01-22T05:21:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
65482025-01-22T05:21:32.829ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65492025-01-22T05:21:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65502025-01-22T05:21:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65512025-01-22T05:21:32.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65522025-01-22T05:21:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65532025-01-22T05:21:32.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65542025-01-22T05:21:32.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65552025-01-22T05:21:32.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65562025-01-22T05:21:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65572025-01-22T05:21:32.831ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65582025-01-22T05:21:32.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65592025-01-22T05:21:32.832ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11475, tv_nsec: 180201566 } })
65602025-01-22T05:21:32.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65612025-01-22T05:21:32.833ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
65622025-01-22T05:21:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65632025-01-22T05:21:32.834ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65642025-01-22T05:21:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65652025-01-22T05:21:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65662025-01-22T05:21:32.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65672025-01-22T05:21:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65682025-01-22T05:21:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65692025-01-22T05:21:32.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65702025-01-22T05:21:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65712025-01-22T05:21:32.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65722025-01-22T05:21:32.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65732025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
65742025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
65752025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65762025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65772025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
65782025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65792025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
65802025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65812025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
65822025-01-22T05:21:32.845ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
65832025-01-22T05:21:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65842025-01-22T05:21:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65852025-01-22T05:21:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65862025-01-22T05:21:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65872025-01-22T05:21:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
65882025-01-22T05:21:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65892025-01-22T05:21:32.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65902025-01-22T05:21:32.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65912025-01-22T05:21:32.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65922025-01-22T05:21:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65932025-01-22T05:21:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65942025-01-22T05:21:32.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65952025-01-22T05:21:32.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65962025-01-22T05:21:32.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65972025-01-22T05:21:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65982025-01-22T05:21:32.854ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
65992025-01-22T05:21:32.854ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66002025-01-22T05:21:32.854ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 29.875139ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66012025-01-22T05:21:32.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66022025-01-22T05:21:32.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66032025-01-22T05:21:32.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66042025-01-22T05:21:32.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11475, tv_nsec: 202178063 } })
66052025-01-22T05:21:32.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66062025-01-22T05:21:32.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
66072025-01-22T05:21:32.858ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.639417ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
66082025-01-22T05:21:32.862ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66092025-01-22T05:21:32.862ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 37.959433ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66102025-01-22T05:21:32.881ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66112025-01-22T05:21:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66122025-01-22T05:21:32.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66132025-01-22T05:21:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
66142025-01-22T05:21:32.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66152025-01-22T05:21:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66162025-01-22T05:21:32.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66172025-01-22T05:21:32.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66182025-01-22T05:21:32.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66192025-01-22T05:21:32.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66202025-01-22T05:21:32.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.70318ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66212025-01-22T05:21:32.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66222025-01-22T05:21:32.898ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
66232025-01-22T05:21:32.898ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
66242025-01-22T05:21:32.898ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 74.457586ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
66252025-01-22T05:21:32.899ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66262025-01-22T05:21:32.899ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66272025-01-22T05:21:32.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66282025-01-22T05:21:32.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66292025-01-22T05:21:32.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66302025-01-22T05:21:32.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66312025-01-22T05:21:32.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66322025-01-22T05:21:32.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66332025-01-22T05:21:32.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66342025-01-22T05:21:32.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66352025-01-22T05:21:32.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66362025-01-22T05:21:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66372025-01-22T05:21:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66382025-01-22T05:21:32.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.261417ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
66392025-01-22T05:21:32.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66402025-01-22T05:21:32.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66412025-01-22T05:21:32.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66422025-01-22T05:21:32.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66432025-01-22T05:21:32.905ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66442025-01-22T05:21:32.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66452025-01-22T05:21:32.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66462025-01-22T05:21:32.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.371278ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66472025-01-22T05:21:32.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66482025-01-22T05:21:32.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66492025-01-22T05:21:32.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66502025-01-22T05:21:32.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.180736ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
66512025-01-22T05:21:32.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66522025-01-22T05:21:32.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66532025-01-22T05:21:32.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66542025-01-22T05:21:32.908ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66552025-01-22T05:21:32.908ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66562025-01-22T05:21:32.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66572025-01-22T05:21:32.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66582025-01-22T05:21:32.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.883771ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66592025-01-22T05:21:32.909ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
66602025-01-22T05:21:32.909ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.796748ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
66612025-01-22T05:21:32.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66622025-01-22T05:21:32.910ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66632025-01-22T05:21:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
66642025-01-22T05:21:32.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66652025-01-22T05:21:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66662025-01-22T05:21:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66672025-01-22T05:21:32.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66682025-01-22T05:21:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66692025-01-22T05:21:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66702025-01-22T05:21:32.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66712025-01-22T05:21:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66722025-01-22T05:21:32.914ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
66732025-01-22T05:21:32.914ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 90.939052ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
66742025-01-22T05:21:32.947ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66752025-01-22T05:21:32.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
66762025-01-22T05:21:32.951ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
66772025-01-22T05:21:32.951ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
66782025-01-22T05:21:32.951ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
66792025-01-22T05:21:32.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66802025-01-22T05:21:32.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66812025-01-22T05:21:32.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66822025-01-22T05:21:32.954ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66832025-01-22T05:21:32.954ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66842025-01-22T05:21:32.954ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.282834ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66852025-01-22T05:21:32.954ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
66862025-01-22T05:21:32.955ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
66872025-01-22T05:21:32.955ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
66882025-01-22T05:21:32.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66892025-01-22T05:21:32.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66902025-01-22T05:21:32.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66912025-01-22T05:21:32.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66922025-01-22T05:21:32.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66932025-01-22T05:21:32.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66942025-01-22T05:21:32.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66952025-01-22T05:21:32.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66962025-01-22T05:21:32.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66972025-01-22T05:21:32.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66982025-01-22T05:21:32.962ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66992025-01-22T05:21:32.962ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
67002025-01-22T05:21:32.962ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
67012025-01-22T05:21:32.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67022025-01-22T05:21:32.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67032025-01-22T05:21:32.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67042025-01-22T05:21:32.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67052025-01-22T05:21:32.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67062025-01-22T05:21:32.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
67072025-01-22T05:21:32.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67082025-01-22T05:21:32.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67092025-01-22T05:21:32.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67102025-01-22T05:21:32.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67112025-01-22T05:21:32.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67122025-01-22T05:21:32.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67132025-01-22T05:21:32.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67142025-01-22T05:21:32.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67152025-01-22T05:21:32.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.387594ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67162025-01-22T05:21:32.970ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.827521ms iteration = 23 status = 0
67172025-01-22T05:21:32.971ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
67182025-01-22T05:21:32.971ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
67192025-01-22T05:21:32.971ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
67202025-01-22T05:21:32.971ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 147.699509ms iteration = 12 status = {"generation":2}
67212025-01-22T05:21:32.983ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
67222025-01-22T05:21:32.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67232025-01-22T05:21:32.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67242025-01-22T05:21:32.995ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67252025-01-22T05:21:32.995ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67262025-01-22T05:21:32.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67272025-01-22T05:21:32.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67282025-01-22T05:21:33.005ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
67292025-01-22T05:21:33.005ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67302025-01-22T05:21:33.005ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "021666ff-04f7-4c44-93f3-6a8a0ddcd348", "content-length": "26", "date": "Wed, 22 Jan 2025 05:21:32 GMT"} })
67312025-01-22T05:21:33.005ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67322025-01-22T05:21:33.007ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67332025-01-22T05:21:33.012ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
67342025-01-22T05:21:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 188.49826ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
67352025-01-22T05:21:33.016ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
67362025-01-22T05:21:33.016ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67372025-01-22T05:21:33.017ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11d2fefd-c2fa-471a-aceb-660ca63c9008", "content-length": "26", "date": "Wed, 22 Jan 2025 05:21:32 GMT"} })
67382025-01-22T05:21:33.017ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67392025-01-22T05:21:33.018ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
67402025-01-22T05:21:33.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67412025-01-22T05:21:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67422025-01-22T05:21:33.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67432025-01-22T05:21:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67442025-01-22T05:21:33.035ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 211.55185ms iteration = 26 status = {"physical_disks_added":0}
67452025-01-22T05:21:33.041ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
67462025-01-22T05:21:33.041ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 217.112992ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
67472025-01-22T05:21:33.081ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
67482025-01-22T05:21:33.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f2f97277-9669-43e9-ba78-089c507933e4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
67492025-01-22T05:21:33.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f2f97277-9669-43e9-ba78-089c507933e4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
67502025-01-22T05:21:33.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67512025-01-22T05:21:33.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67522025-01-22T05:21:33.139ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
67532025-01-22T05:21:33.139ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67542025-01-22T05:21:33.139ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b156c01d-bb3d-4ad4-a236-f7c2850d20e8", "content-length": "26", "date": "Wed, 22 Jan 2025 05:21:32 GMT"} })
67552025-01-22T05:21:33.139ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67562025-01-22T05:21:33.141ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67572025-01-22T05:21:33.154ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
67582025-01-22T05:21:33.154ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "290444aa-7723-4cb2-b0a3-74796c33ad27", "date": "Wed, 22 Jan 2025 05:21:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67592025-01-22T05:21:33.154ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67602025-01-22T05:21:33.156ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b43178eb-cfab-4fbc-bd54-d1bd89eed8de", "date": "Wed, 22 Jan 2025 05:21:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67612025-01-22T05:21:33.156ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67622025-01-22T05:21:33.157ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67632025-01-22T05:21:33.157ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 334.349161ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
67642025-01-22T05:21:33.252ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67652025-01-22T05:21:33.270ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67662025-01-22T05:21:33.270ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67672025-01-22T05:21:33.271ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "293cb39a-50de-4c06-acb1-7173b1a991c8", "content-length": "372", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
67682025-01-22T05:21:33.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67692025-01-22T05:21:33.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67702025-01-22T05:21:33.273ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
67712025-01-22T05:21:33.273ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67722025-01-22T05:21:33.273ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
67732025-01-22T05:21:33.273ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 449.529337ms iteration = 12 status = {"generation":1}
67742025-01-22T05:21:33.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 189624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f2f97277-9669-43e9-ba78-089c507933e4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
67752025-01-22T05:21:33.280ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 457.350466ms iteration = 23 status = {}
67762025-01-22T05:21:33.287ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67772025-01-22T05:21:33.287ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "75e3efa9-6637-4a9e-aeba-2df18742f208", "content-length": "1", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
67782025-01-22T05:21:33.288ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67792025-01-22T05:21:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67802025-01-22T05:21:33.290ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 467.036294ms iteration = 23 status = null
67812025-01-22T05:21:33.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67822025-01-22T05:21:33.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67832025-01-22T05:21:33.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67842025-01-22T05:21:33.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67852025-01-22T05:21:33.313ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
67862025-01-22T05:21:33.313ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67872025-01-22T05:21:33.314ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0a6eb6c9-a015-461e-9471-58b2e4eacd5b", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
67882025-01-22T05:21:33.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67892025-01-22T05:21:33.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67902025-01-22T05:21:33.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67912025-01-22T05:21:33.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67922025-01-22T05:21:33.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67932025-01-22T05:21:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67942025-01-22T05:21:33.323ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67952025-01-22T05:21:33.323ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67962025-01-22T05:21:33.323ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dac23756-9d37-4890-bf2f-7fa5b0a8a0ba", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
67972025-01-22T05:21:33.325ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 501.135999ms iteration = 23 status = {}
67982025-01-22T05:21:33.329ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
67992025-01-22T05:21:33.329ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a74b7adb-8358-4a6a-ba32-726f9ddc5096", "date": "Wed, 22 Jan 2025 05:21:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
68002025-01-22T05:21:33.329ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
68012025-01-22T05:21:33.330ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f75b4bbc-80f0-456a-ab0e-882a2b691e5b", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
68022025-01-22T05:21:33.331ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
68032025-01-22T05:21:33.332ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bf9b3f90-4782-44cb-9d5d-f75ee39c5279", "date": "Wed, 22 Jan 2025 05:21:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
68042025-01-22T05:21:33.332ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
68052025-01-22T05:21:33.334ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
68062025-01-22T05:21:33.334ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 511.394188ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
68072025-01-22T05:21:33.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68082025-01-22T05:21:33.340ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68092025-01-22T05:21:33.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68102025-01-22T05:21:33.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68112025-01-22T05:21:33.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68122025-01-22T05:21:33.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68132025-01-22T05:21:33.346ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
68142025-01-22T05:21:33.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68152025-01-22T05:21:33.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68162025-01-22T05:21:33.374ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68172025-01-22T05:21:33.374ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7f8ce8a-8995-4700-b385-e0969e61e43a", "content-length": "691", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
68182025-01-22T05:21:33.374ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
68192025-01-22T05:21:33.374ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
68202025-01-22T05:21:33.374ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
68212025-01-22T05:21:33.375ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 552.148798ms iteration = 23 status = {}
68222025-01-22T05:21:33.384ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68232025-01-22T05:21:33.384ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b044a8ae-a0d5-4234-bd75-ef9a5cfc76d8", "content-length": "134", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
68242025-01-22T05:21:33.384ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68252025-01-22T05:21:33.384ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
68262025-01-22T05:21:33.384ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68272025-01-22T05:21:33.384ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68282025-01-22T05:21:33.384ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68292025-01-22T05:21:33.384ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68302025-01-22T05:21:33.384ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68312025-01-22T05:21:33.384ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68322025-01-22T05:21:33.384ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68332025-01-22T05:21:33.385ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68342025-01-22T05:21:33.385ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
68352025-01-22T05:21:33.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68362025-01-22T05:21:33.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68372025-01-22T05:21:33.387ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68382025-01-22T05:21:33.387ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "474d65a7-fd97-4034-ae54-124f69e5c2b5", "content-length": "2", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
68392025-01-22T05:21:33.387ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68402025-01-22T05:21:33.387ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "56a8a145-7209-407b-8170-b4277e4d59b2", "content-length": "51", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
68412025-01-22T05:21:33.387ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
68422025-01-22T05:21:33.387ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68432025-01-22T05:21:33.482ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "686039d6-19d7-4c52-a0f2-8d2c997ba6d3", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
68442025-01-22T05:21:33.482ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
68452025-01-22T05:21:33.482ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68462025-01-22T05:21:33.482ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8921a047-8a14-4d24-b863-4d9ce9b70061", "content-length": "682", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
68472025-01-22T05:21:33.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68482025-01-22T05:21:33.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68492025-01-22T05:21:33.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68502025-01-22T05:21:33.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68512025-01-22T05:21:33.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68522025-01-22T05:21:33.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68532025-01-22T05:21:33.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68542025-01-22T05:21:33.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68552025-01-22T05:21:33.500ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 676.792107ms iteration = 23 status = {}
68562025-01-22T05:21:33.874ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
68572025-01-22T05:21:33.874ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
68582025-01-22T05:21:33.904ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
68592025-01-22T05:21:33.904ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:43376
68602025-01-22T05:21:33.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43376 req_id = 07c96e1b-37e5-45bd-853f-e643b03d45b1 roles = RoleSet { roles: {} } uri = /metrics/producers
68612025-01-22T05:21:33.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43376 req_id = 07c96e1b-37e5-45bd-853f-e643b03d45b1 resource = Database result = Ok(()) uri = /metrics/producers
68622025-01-22T05:21:33.947ZINFOnexus: assigned collector to new producer collector_id = 95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0 file = nexus/src/app/oximeter.rs:76 producer_id = 3fbe3917-aca1-4b36-8119-948b03a24746
68632025-01-22T05:21:33.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42496 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43376 req_id = 07c96e1b-37e5-45bd-853f-e643b03d45b1 response_code = 201 uri = /metrics/producers
68642025-01-22T05:21:33.947ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "07c96e1b-37e5-45bd-853f-e643b03d45b1", "content-length": "41", "date": "Wed, 22 Jan 2025 05:21:33 GMT"} })
68652025-01-22T05:21:33.949ZDEBGnexus (producer-registration-task): registered with nexus successfully
68662025-01-22T05:21:33.949ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
68672025-01-22T05:21:34.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = caef4652-b5e0-4629-8fb6-54276c37ece9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
68682025-01-22T05:21:34.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = caef4652-b5e0-4629-8fb6-54276c37ece9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
68692025-01-22T05:21:34.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = caef4652-b5e0-4629-8fb6-54276c37ece9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
68702025-01-22T05:21:34.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4bbe988c-71fa-4ffa-93c4-aa25d0d1d9f1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68712025-01-22T05:21:34.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4bbe988c-71fa-4ffa-93c4-aa25d0d1d9f1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68722025-01-22T05:21:34.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4bbe988c-71fa-4ffa-93c4-aa25d0d1d9f1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68732025-01-22T05:21:35.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 466a1772-6abb-4a06-8596-5c4a64a96450 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68742025-01-22T05:21:35.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 466a1772-6abb-4a06-8596-5c4a64a96450 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68752025-01-22T05:21:35.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 466a1772-6abb-4a06-8596-5c4a64a96450 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68762025-01-22T05:21:35.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 471 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = dadeeacb-b8e8-4a52-8d95-14727a441d38 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
68772025-01-22T05:21:36.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 152a9590-eac0-4cf1-8c42-cbf829b770db roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68782025-01-22T05:21:36.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 152a9590-eac0-4cf1-8c42-cbf829b770db resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68792025-01-22T05:21:36.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 152a9590-eac0-4cf1-8c42-cbf829b770db response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68802025-01-22T05:21:37.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f747fe7-9629-4bf8-9f74-62c1e6c179ee roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68812025-01-22T05:21:37.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f747fe7-9629-4bf8-9f74-62c1e6c179ee resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68822025-01-22T05:21:37.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f747fe7-9629-4bf8-9f74-62c1e6c179ee response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68832025-01-22T05:21:38.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f0a06dc1-de1f-43db-9831-721df255b099 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68842025-01-22T05:21:38.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f0a06dc1-de1f-43db-9831-721df255b099 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68852025-01-22T05:21:38.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f0a06dc1-de1f-43db-9831-721df255b099 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68862025-01-22T05:21:39.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fb9ad747-bc5e-46a1-8e9f-643f8939729a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68872025-01-22T05:21:39.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fb9ad747-bc5e-46a1-8e9f-643f8939729a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68882025-01-22T05:21:39.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fb9ad747-bc5e-46a1-8e9f-643f8939729a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68892025-01-22T05:21:40.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2de16009-ce7e-4fd2-9488-32f01061ddef roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68902025-01-22T05:21:40.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2de16009-ce7e-4fd2-9488-32f01061ddef resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68912025-01-22T05:21:40.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2de16009-ce7e-4fd2-9488-32f01061ddef response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68922025-01-22T05:21:41.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1263f74a-85ff-4621-8d44-4d8d399cc20f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68932025-01-22T05:21:41.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1263f74a-85ff-4621-8d44-4d8d399cc20f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68942025-01-22T05:21:41.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1263f74a-85ff-4621-8d44-4d8d399cc20f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68952025-01-22T05:21:42.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f8aa74c3-151e-42ce-a906-71e49a958744 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68962025-01-22T05:21:42.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f8aa74c3-151e-42ce-a906-71e49a958744 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68972025-01-22T05:21:42.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f8aa74c3-151e-42ce-a906-71e49a958744 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
68982025-01-22T05:21:42.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
68992025-01-22T05:21:42.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69002025-01-22T05:21:42.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
69012025-01-22T05:21:42.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69022025-01-22T05:21:42.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69032025-01-22T05:21:42.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69042025-01-22T05:21:42.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69052025-01-22T05:21:42.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69062025-01-22T05:21:42.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69072025-01-22T05:21:42.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69082025-01-22T05:21:42.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69092025-01-22T05:21:42.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69102025-01-22T05:21:42.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69112025-01-22T05:21:42.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69122025-01-22T05:21:42.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.064774ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69132025-01-22T05:21:42.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69142025-01-22T05:21:42.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
69152025-01-22T05:21:42.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69162025-01-22T05:21:42.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69172025-01-22T05:21:42.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
69182025-01-22T05:21:42.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.696689ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
69192025-01-22T05:21:43.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4cd54bb4-6747-4fe5-be1f-b0d2f583f2e5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69202025-01-22T05:21:43.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4cd54bb4-6747-4fe5-be1f-b0d2f583f2e5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69212025-01-22T05:21:43.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4cd54bb4-6747-4fe5-be1f-b0d2f583f2e5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69222025-01-22T05:21:44.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f258eac-0b2d-4d7b-bf63-cf258fa98a79 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69232025-01-22T05:21:44.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f258eac-0b2d-4d7b-bf63-cf258fa98a79 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69242025-01-22T05:21:44.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f258eac-0b2d-4d7b-bf63-cf258fa98a79 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69252025-01-22T05:21:45.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c513b48-4140-4826-8a03-70c2ab57d885 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69262025-01-22T05:21:45.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c513b48-4140-4826-8a03-70c2ab57d885 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69272025-01-22T05:21:45.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c513b48-4140-4826-8a03-70c2ab57d885 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69282025-01-22T05:21:45.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 47484c08-2758-49d4-be3c-84fcb38725e5 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
69292025-01-22T05:21:45.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 47484c08-2758-49d4-be3c-84fcb38725e5 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
69302025-01-22T05:21:45.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 47484c08-2758-49d4-be3c-84fcb38725e5 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
69312025-01-22T05:21:45.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 18fd7a96-c17c-4068-ac85-b09ddf3590da roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
69322025-01-22T05:21:45.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 18fd7a96-c17c-4068-ac85-b09ddf3590da resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
69332025-01-22T05:21:45.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 18fd7a96-c17c-4068-ac85-b09ddf3590da response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
69342025-01-22T05:21:45.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 806 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = a789bc76-4cd2-4c74-8072-ad22747a05f2 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
69352025-01-22T05:21:46.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e1862cf7-ff7b-45de-9438-44b0c6fd29d6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69362025-01-22T05:21:46.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e1862cf7-ff7b-45de-9438-44b0c6fd29d6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69372025-01-22T05:21:46.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e1862cf7-ff7b-45de-9438-44b0c6fd29d6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69382025-01-22T05:21:47.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72de4e11-2cc3-437d-9bb0-6224d5959803 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69392025-01-22T05:21:47.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72de4e11-2cc3-437d-9bb0-6224d5959803 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69402025-01-22T05:21:47.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72de4e11-2cc3-437d-9bb0-6224d5959803 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69412025-01-22T05:21:48.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1aa697ad-d77c-45cf-93ad-1c0389956759 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69422025-01-22T05:21:48.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1aa697ad-d77c-45cf-93ad-1c0389956759 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69432025-01-22T05:21:48.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1aa697ad-d77c-45cf-93ad-1c0389956759 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69442025-01-22T05:21:49.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 699958d7-4a0b-4c65-814e-ffd8fef9a948 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69452025-01-22T05:21:49.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 699958d7-4a0b-4c65-814e-ffd8fef9a948 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69462025-01-22T05:21:49.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 699958d7-4a0b-4c65-814e-ffd8fef9a948 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69472025-01-22T05:21:50.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = af130d24-8189-43f6-a6ac-9b3dd43b7a9e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69482025-01-22T05:21:50.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = af130d24-8189-43f6-a6ac-9b3dd43b7a9e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69492025-01-22T05:21:50.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = af130d24-8189-43f6-a6ac-9b3dd43b7a9e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69502025-01-22T05:21:51.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 45a28493-5bd0-4df2-889f-2bb9a3a59b01 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69512025-01-22T05:21:51.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 45a28493-5bd0-4df2-889f-2bb9a3a59b01 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69522025-01-22T05:21:51.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 45a28493-5bd0-4df2-889f-2bb9a3a59b01 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69532025-01-22T05:21:52.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 51942ca7-b3b0-4a8a-9489-caa6080bc165 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69542025-01-22T05:21:52.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 51942ca7-b3b0-4a8a-9489-caa6080bc165 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69552025-01-22T05:21:52.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 51942ca7-b3b0-4a8a-9489-caa6080bc165 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69562025-01-22T05:21:52.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
69572025-01-22T05:21:52.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69582025-01-22T05:21:52.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69592025-01-22T05:21:52.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
69602025-01-22T05:21:52.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69612025-01-22T05:21:52.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69622025-01-22T05:21:52.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69632025-01-22T05:21:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69642025-01-22T05:21:52.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69652025-01-22T05:21:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69662025-01-22T05:21:52.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69672025-01-22T05:21:52.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69682025-01-22T05:21:52.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69692025-01-22T05:21:52.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
69702025-01-22T05:21:52.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69712025-01-22T05:21:52.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69722025-01-22T05:21:52.846ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
69732025-01-22T05:21:52.846ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.096501ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
69742025-01-22T05:21:52.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69752025-01-22T05:21:52.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69762025-01-22T05:21:52.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.119243ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69772025-01-22T05:21:53.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2df8645b-59f7-46cd-a83a-64893e7557bd roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69782025-01-22T05:21:53.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2df8645b-59f7-46cd-a83a-64893e7557bd resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69792025-01-22T05:21:53.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2df8645b-59f7-46cd-a83a-64893e7557bd response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69802025-01-22T05:21:54.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 49f2934b-bc89-4784-8927-4cc57fd8ffee roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69812025-01-22T05:21:54.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 49f2934b-bc89-4784-8927-4cc57fd8ffee resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69822025-01-22T05:21:54.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 49f2934b-bc89-4784-8927-4cc57fd8ffee response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69832025-01-22T05:21:55.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 939b0d61-ea92-43fb-b2fd-eb0072fe2ace roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69842025-01-22T05:21:55.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 939b0d61-ea92-43fb-b2fd-eb0072fe2ace resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69852025-01-22T05:21:55.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 939b0d61-ea92-43fb-b2fd-eb0072fe2ace response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69862025-01-22T05:21:55.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 743 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 60f63ea7-e759-46dd-b11b-f6a725501ffb response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
69872025-01-22T05:21:56.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 13c74f79-19d2-4861-86db-7d3cfc5b48aa roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69882025-01-22T05:21:56.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 13c74f79-19d2-4861-86db-7d3cfc5b48aa resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69892025-01-22T05:21:56.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 13c74f79-19d2-4861-86db-7d3cfc5b48aa response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69902025-01-22T05:21:57.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 664488ee-1997-40ff-bd62-ee9cf8d2831b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69912025-01-22T05:21:57.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 664488ee-1997-40ff-bd62-ee9cf8d2831b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69922025-01-22T05:21:57.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 664488ee-1997-40ff-bd62-ee9cf8d2831b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69932025-01-22T05:21:58.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a59be074-dba0-4056-8999-b5378bc0c1a0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69942025-01-22T05:21:58.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a59be074-dba0-4056-8999-b5378bc0c1a0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69952025-01-22T05:21:58.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a59be074-dba0-4056-8999-b5378bc0c1a0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69962025-01-22T05:21:59.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fdc3f66f-5a89-4927-a2f1-6a98bb8079e9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69972025-01-22T05:21:59.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fdc3f66f-5a89-4927-a2f1-6a98bb8079e9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69982025-01-22T05:21:59.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fdc3f66f-5a89-4927-a2f1-6a98bb8079e9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
69992025-01-22T05:22:00.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5d15e087-b38b-4b8d-9ed9-a35fa087443a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
70002025-01-22T05:22:00.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5d15e087-b38b-4b8d-9ed9-a35fa087443a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
70012025-01-22T05:22:00.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5d15e087-b38b-4b8d-9ed9-a35fa087443a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
70022025-01-22T05:22:00.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 486c68e0-51f4-4c2b-94aa-706d4ae8346d roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
70032025-01-22T05:22:00.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 486c68e0-51f4-4c2b-94aa-706d4ae8346d resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
70042025-01-22T05:22:00.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = 486c68e0-51f4-4c2b-94aa-706d4ae8346d response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
70052025-01-22T05:22:00.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = c2f548a8-3ea4-4f53-8109-0fed356f026a roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
70062025-01-22T05:22:00.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = c2f548a8-3ea4-4f53-8109-0fed356f026a resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
70072025-01-22T05:22:00.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57662 req_id = c2f548a8-3ea4-4f53-8109-0fed356f026a response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
70082025-01-22T05:22:01.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fec5f759-ce61-4140-a6e4-ff69fa0aa954 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
70092025-01-22T05:22:01.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fec5f759-ce61-4140-a6e4-ff69fa0aa954 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
70102025-01-22T05:22:01.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fec5f759-ce61-4140-a6e4-ff69fa0aa954 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
70112025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
70122025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
70132025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70142025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
70152025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
70162025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
70172025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70182025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70192025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70202025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
70212025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
70222025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70232025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70242025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
70252025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70262025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
70272025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70282025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
70292025-01-22T05:22:02.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70302025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70312025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70322025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70332025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70342025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70352025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70362025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70372025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70382025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70392025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
70402025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
70412025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70422025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70432025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70442025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
70452025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70462025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
70472025-01-22T05:22:02.824ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70482025-01-22T05:22:02.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70492025-01-22T05:22:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70502025-01-22T05:22:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70512025-01-22T05:22:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70522025-01-22T05:22:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70532025-01-22T05:22:02.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70542025-01-22T05:22:02.827ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11505, tv_nsec: 174455269 } })
70552025-01-22T05:22:02.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70562025-01-22T05:22:02.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
70572025-01-22T05:22:02.828ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70582025-01-22T05:22:02.828ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.852189ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70592025-01-22T05:22:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70602025-01-22T05:22:02.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70612025-01-22T05:22:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70622025-01-22T05:22:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70632025-01-22T05:22:02.830ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70642025-01-22T05:22:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70652025-01-22T05:22:02.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70662025-01-22T05:22:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70672025-01-22T05:22:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70682025-01-22T05:22:02.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70692025-01-22T05:22:02.833ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11505, tv_nsec: 180328428 } })
70702025-01-22T05:22:02.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70712025-01-22T05:22:02.833ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
70722025-01-22T05:22:02.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70732025-01-22T05:22:02.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70742025-01-22T05:22:02.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70752025-01-22T05:22:02.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70762025-01-22T05:22:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70772025-01-22T05:22:02.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70782025-01-22T05:22:02.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70792025-01-22T05:22:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70802025-01-22T05:22:02.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70812025-01-22T05:22:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70822025-01-22T05:22:02.838ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11505, tv_nsec: 185818740 } })
70832025-01-22T05:22:02.839ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
70842025-01-22T05:22:02.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70852025-01-22T05:22:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70862025-01-22T05:22:02.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70872025-01-22T05:22:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70882025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
70892025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
70902025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70912025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70922025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
70932025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70942025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
70952025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70962025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70972025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70982025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70992025-01-22T05:22:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71002025-01-22T05:22:02.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71012025-01-22T05:22:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
71022025-01-22T05:22:02.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71032025-01-22T05:22:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71042025-01-22T05:22:02.877ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71052025-01-22T05:22:02.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71062025-01-22T05:22:02.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71072025-01-22T05:22:02.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71082025-01-22T05:22:02.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71092025-01-22T05:22:02.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71102025-01-22T05:22:02.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71112025-01-22T05:22:02.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71122025-01-22T05:22:02.884ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71132025-01-22T05:22:02.884ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71142025-01-22T05:22:02.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71152025-01-22T05:22:02.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71162025-01-22T05:22:02.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71172025-01-22T05:22:02.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71182025-01-22T05:22:02.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71192025-01-22T05:22:02.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71202025-01-22T05:22:02.885ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71212025-01-22T05:22:02.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71222025-01-22T05:22:02.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71232025-01-22T05:22:02.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71242025-01-22T05:22:02.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.682319ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
71252025-01-22T05:22:02.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.817562ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
71262025-01-22T05:22:02.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71272025-01-22T05:22:02.891ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
71282025-01-22T05:22:02.891ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.595256ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
71292025-01-22T05:22:02.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71302025-01-22T05:22:02.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71312025-01-22T05:22:02.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71322025-01-22T05:22:02.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71332025-01-22T05:22:02.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71342025-01-22T05:22:02.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71352025-01-22T05:22:02.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71362025-01-22T05:22:02.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.593124ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71372025-01-22T05:22:02.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71382025-01-22T05:22:02.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71392025-01-22T05:22:02.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 51bf0733-eefa-45da-88de-6e48acb4d163 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
71402025-01-22T05:22:02.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 51bf0733-eefa-45da-88de-6e48acb4d163 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
71412025-01-22T05:22:02.920ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71422025-01-22T05:22:02.920ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71432025-01-22T05:22:02.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71442025-01-22T05:22:02.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.462725ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71452025-01-22T05:22:02.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71462025-01-22T05:22:02.924ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
71472025-01-22T05:22:02.924ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71482025-01-22T05:22:02.924ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7ed2faa-4716-4421-b823-5e7e42a662e5", "content-length": "26", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
71492025-01-22T05:22:02.924ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71502025-01-22T05:22:02.926ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
71512025-01-22T05:22:02.926ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71522025-01-22T05:22:02.926ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9287534a-af71-4a85-8817-c31b08c62ac5", "content-length": "26", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
71532025-01-22T05:22:02.926ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71542025-01-22T05:22:02.926ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71552025-01-22T05:22:02.928ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71562025-01-22T05:22:02.929ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71572025-01-22T05:22:02.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
71582025-01-22T05:22:02.930ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71592025-01-22T05:22:02.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71602025-01-22T05:22:02.932ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
71612025-01-22T05:22:02.932ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71622025-01-22T05:22:02.932ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "00814940-92c1-4662-9725-475719d07126", "content-length": "26", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
71632025-01-22T05:22:02.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71642025-01-22T05:22:02.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.973532ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71652025-01-22T05:22:02.934ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71662025-01-22T05:22:02.934ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.556602ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71672025-01-22T05:22:02.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
71682025-01-22T05:22:02.953ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71692025-01-22T05:22:02.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71702025-01-22T05:22:02.964ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 140.36459ms iteration = 27 status = {"physical_disks_added":0}
71712025-01-22T05:22:03.003ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71722025-01-22T05:22:03.003ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71732025-01-22T05:22:03.004ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9f7b90b-5be0-4c9f-aaf1-d2548c969a37", "content-length": "372", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
71742025-01-22T05:22:03.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71752025-01-22T05:22:03.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71762025-01-22T05:22:03.005ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71772025-01-22T05:22:03.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71782025-01-22T05:22:03.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71792025-01-22T05:22:03.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 51bf0733-eefa-45da-88de-6e48acb4d163 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
71802025-01-22T05:22:03.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71812025-01-22T05:22:03.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71822025-01-22T05:22:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
71832025-01-22T05:22:03.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71842025-01-22T05:22:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71852025-01-22T05:22:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 190.895118ms iteration = 24 status = 0
71862025-01-22T05:22:03.045ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
71872025-01-22T05:22:03.045ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 221.525843ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
71882025-01-22T05:22:03.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 206.66464ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71892025-01-22T05:22:03.054ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
71902025-01-22T05:22:03.054ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71912025-01-22T05:22:03.054ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9d516084-cf34-47fd-ac96-0b866f47fdd2", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
71922025-01-22T05:22:03.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71932025-01-22T05:22:03.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71942025-01-22T05:22:03.055ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71952025-01-22T05:22:03.055ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71962025-01-22T05:22:03.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 230.573197ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71972025-01-22T05:22:03.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71982025-01-22T05:22:03.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71992025-01-22T05:22:03.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72002025-01-22T05:22:03.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72012025-01-22T05:22:03.064ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72022025-01-22T05:22:03.064ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72032025-01-22T05:22:03.064ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e40c7378-10d8-4781-9b7a-e137a98f202a", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
72042025-01-22T05:22:03.065ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 240.883478ms iteration = 24 status = {}
72052025-01-22T05:22:03.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72062025-01-22T05:22:03.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72072025-01-22T05:22:03.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72082025-01-22T05:22:03.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72092025-01-22T05:22:03.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72102025-01-22T05:22:03.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72112025-01-22T05:22:03.138ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72122025-01-22T05:22:03.138ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "29730319-5ead-45bc-af3c-86a15d261108", "content-length": "1", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
72132025-01-22T05:22:03.139ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 315.930656ms iteration = 24 status = {}
72142025-01-22T05:22:03.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72152025-01-22T05:22:03.140ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72162025-01-22T05:22:03.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72172025-01-22T05:22:03.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72182025-01-22T05:22:03.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72192025-01-22T05:22:03.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72202025-01-22T05:22:03.142ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 318.523159ms iteration = 24 status = null
72212025-01-22T05:22:03.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72222025-01-22T05:22:03.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72232025-01-22T05:22:03.208ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
72242025-01-22T05:22:03.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72252025-01-22T05:22:03.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72262025-01-22T05:22:03.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72272025-01-22T05:22:03.218ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c7f5494-6f98-4131-9710-e2cc8496fd7b", "content-length": "134", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
72282025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72292025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
72302025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72312025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72322025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72332025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72342025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72352025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72362025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72372025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72382025-01-22T05:22:03.218ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
72392025-01-22T05:22:03.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72402025-01-22T05:22:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72412025-01-22T05:22:03.221ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72422025-01-22T05:22:03.221ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9817273-e394-4e3e-9d11-b7f5e3ccfd2a", "content-length": "2", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
72432025-01-22T05:22:03.221ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72442025-01-22T05:22:03.221ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7845412c-9235-432c-8bcc-50d66b39fb0d", "content-length": "51", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
72452025-01-22T05:22:03.221ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
72462025-01-22T05:22:03.221ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72472025-01-22T05:22:03.231ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72482025-01-22T05:22:03.319ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9ef73a08-a03e-46f5-a5cd-3635a709e36a", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
72492025-01-22T05:22:03.319ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
72502025-01-22T05:22:03.319ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72512025-01-22T05:22:03.319ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "77587da1-e78f-4d15-b4c9-2b455fe19920", "content-length": "691", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
72522025-01-22T05:22:03.319ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72532025-01-22T05:22:03.319ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72542025-01-22T05:22:03.319ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72552025-01-22T05:22:03.319ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b076ca1d-044c-4819-993b-a94f95eac8fd", "content-length": "682", "date": "Wed, 22 Jan 2025 05:22:02 GMT"} })
72562025-01-22T05:22:03.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72572025-01-22T05:22:03.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72582025-01-22T05:22:03.320ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 496.900062ms iteration = 24 status = {}
72592025-01-22T05:22:03.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72602025-01-22T05:22:03.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72612025-01-22T05:22:03.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72622025-01-22T05:22:03.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72632025-01-22T05:22:03.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72642025-01-22T05:22:03.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72652025-01-22T05:22:03.336ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 513.179174ms iteration = 24 status = {}
72662025-01-22T05:22:04.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 88971a24-86ac-4498-95d7-718fb98de37a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72672025-01-22T05:22:04.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 88971a24-86ac-4498-95d7-718fb98de37a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72682025-01-22T05:22:04.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 88971a24-86ac-4498-95d7-718fb98de37a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72692025-01-22T05:22:04.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 6208e8bc-74c6-44dc-9192-8e0e3f6dc6d3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
72702025-01-22T05:22:04.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 6208e8bc-74c6-44dc-9192-8e0e3f6dc6d3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
72712025-01-22T05:22:04.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 6208e8bc-74c6-44dc-9192-8e0e3f6dc6d3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
72722025-01-22T05:22:05.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0e5afb8a-3a65-4011-af66-cc40c4bcf322 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72732025-01-22T05:22:05.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0e5afb8a-3a65-4011-af66-cc40c4bcf322 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72742025-01-22T05:22:05.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0e5afb8a-3a65-4011-af66-cc40c4bcf322 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72752025-01-22T05:22:05.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 845 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = f16093e6-e483-4d14-955f-3403a79436d5 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
72762025-01-22T05:22:06.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d785ce98-9945-4aaf-a34c-382abdc3d16e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72772025-01-22T05:22:06.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d785ce98-9945-4aaf-a34c-382abdc3d16e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72782025-01-22T05:22:06.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d785ce98-9945-4aaf-a34c-382abdc3d16e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72792025-01-22T05:22:07.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ec4b78d8-543b-4011-a728-4257e8cd8d09 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72802025-01-22T05:22:07.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ec4b78d8-543b-4011-a728-4257e8cd8d09 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72812025-01-22T05:22:07.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ec4b78d8-543b-4011-a728-4257e8cd8d09 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72822025-01-22T05:22:08.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 99dff29e-81d7-408a-a208-1b8a30212fda roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72832025-01-22T05:22:08.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 99dff29e-81d7-408a-a208-1b8a30212fda resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72842025-01-22T05:22:08.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 99dff29e-81d7-408a-a208-1b8a30212fda response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72852025-01-22T05:22:09.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50bd6b91-6fc6-48ec-986c-ddfc09236cb7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72862025-01-22T05:22:09.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50bd6b91-6fc6-48ec-986c-ddfc09236cb7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72872025-01-22T05:22:09.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50bd6b91-6fc6-48ec-986c-ddfc09236cb7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72882025-01-22T05:22:10.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a41a709-d965-459e-961f-a16f3912d2c9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72892025-01-22T05:22:10.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a41a709-d965-459e-961f-a16f3912d2c9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72902025-01-22T05:22:10.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a41a709-d965-459e-961f-a16f3912d2c9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72912025-01-22T05:22:11.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c618bd57-1914-4679-85c0-147eb1bef649 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72922025-01-22T05:22:11.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c618bd57-1914-4679-85c0-147eb1bef649 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72932025-01-22T05:22:11.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c618bd57-1914-4679-85c0-147eb1bef649 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72942025-01-22T05:22:12.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8d561aaf-ee41-413a-8cee-4f71dbe341f4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72952025-01-22T05:22:12.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8d561aaf-ee41-413a-8cee-4f71dbe341f4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72962025-01-22T05:22:12.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8d561aaf-ee41-413a-8cee-4f71dbe341f4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
72972025-01-22T05:22:12.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
72982025-01-22T05:22:12.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72992025-01-22T05:22:12.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73002025-01-22T05:22:12.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
73012025-01-22T05:22:12.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73022025-01-22T05:22:12.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73032025-01-22T05:22:12.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73042025-01-22T05:22:12.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73052025-01-22T05:22:12.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73062025-01-22T05:22:12.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73072025-01-22T05:22:12.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73082025-01-22T05:22:12.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73092025-01-22T05:22:12.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73102025-01-22T05:22:12.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
73112025-01-22T05:22:12.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73122025-01-22T05:22:12.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73132025-01-22T05:22:12.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
73142025-01-22T05:22:12.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.285764ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
73152025-01-22T05:22:12.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73162025-01-22T05:22:12.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73172025-01-22T05:22:12.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.501571ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73182025-01-22T05:22:13.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2730c230-8c25-4bc1-9d14-d139af961f52 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73192025-01-22T05:22:13.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2730c230-8c25-4bc1-9d14-d139af961f52 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73202025-01-22T05:22:13.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2730c230-8c25-4bc1-9d14-d139af961f52 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73212025-01-22T05:22:14.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ac682ff8-cd3c-48c0-8eb5-ecee7a30cff7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73222025-01-22T05:22:14.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ac682ff8-cd3c-48c0-8eb5-ecee7a30cff7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73232025-01-22T05:22:14.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ac682ff8-cd3c-48c0-8eb5-ecee7a30cff7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73242025-01-22T05:22:15.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1289cba7-82cb-47eb-a0b5-064297e8bf28 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73252025-01-22T05:22:15.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1289cba7-82cb-47eb-a0b5-064297e8bf28 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73262025-01-22T05:22:15.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1289cba7-82cb-47eb-a0b5-064297e8bf28 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73272025-01-22T05:22:15.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 4000020e-e224-4d24-b561-e6e2a949671c response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
73282025-01-22T05:22:16.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 29774dbe-d6f4-4f1a-807b-0cd9019c720a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73292025-01-22T05:22:16.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 29774dbe-d6f4-4f1a-807b-0cd9019c720a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73302025-01-22T05:22:16.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 29774dbe-d6f4-4f1a-807b-0cd9019c720a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73312025-01-22T05:22:17.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 53ea287a-ec0b-46c8-9802-a4c8a4427c47 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73322025-01-22T05:22:17.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 53ea287a-ec0b-46c8-9802-a4c8a4427c47 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73332025-01-22T05:22:17.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 53ea287a-ec0b-46c8-9802-a4c8a4427c47 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73342025-01-22T05:22:18.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ae106e81-2fb3-4ddf-b25c-0705a0b94543 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73352025-01-22T05:22:18.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ae106e81-2fb3-4ddf-b25c-0705a0b94543 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73362025-01-22T05:22:18.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ae106e81-2fb3-4ddf-b25c-0705a0b94543 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73372025-01-22T05:22:19.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 67faf205-ddda-4034-aa48-f5f46556cd64 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73382025-01-22T05:22:19.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 67faf205-ddda-4034-aa48-f5f46556cd64 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73392025-01-22T05:22:19.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 67faf205-ddda-4034-aa48-f5f46556cd64 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73402025-01-22T05:22:20.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a818fcda-33ea-42ad-8b71-c5a59f8019d6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73412025-01-22T05:22:20.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a818fcda-33ea-42ad-8b71-c5a59f8019d6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73422025-01-22T05:22:20.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a818fcda-33ea-42ad-8b71-c5a59f8019d6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73432025-01-22T05:22:21.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b72d7175-5acf-448d-9b2d-5c90744c0310 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73442025-01-22T05:22:21.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b72d7175-5acf-448d-9b2d-5c90744c0310 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73452025-01-22T05:22:21.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b72d7175-5acf-448d-9b2d-5c90744c0310 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73462025-01-22T05:22:22.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1932f81a-bc9a-4ddb-adcf-7365da095a54 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73472025-01-22T05:22:22.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1932f81a-bc9a-4ddb-adcf-7365da095a54 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73482025-01-22T05:22:22.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1932f81a-bc9a-4ddb-adcf-7365da095a54 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73492025-01-22T05:22:22.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
73502025-01-22T05:22:22.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73512025-01-22T05:22:22.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73522025-01-22T05:22:22.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
73532025-01-22T05:22:22.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73542025-01-22T05:22:22.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73552025-01-22T05:22:22.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73562025-01-22T05:22:22.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73572025-01-22T05:22:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73582025-01-22T05:22:22.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73592025-01-22T05:22:22.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73602025-01-22T05:22:22.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73612025-01-22T05:22:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73622025-01-22T05:22:22.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73632025-01-22T05:22:22.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73642025-01-22T05:22:22.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
73652025-01-22T05:22:22.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73662025-01-22T05:22:22.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73672025-01-22T05:22:22.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
73682025-01-22T05:22:22.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.163071ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
73692025-01-22T05:22:22.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.679825ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73702025-01-22T05:22:23.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f59254c-2f30-4775-b959-7a81687fda32 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73712025-01-22T05:22:23.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f59254c-2f30-4775-b959-7a81687fda32 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73722025-01-22T05:22:23.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f59254c-2f30-4775-b959-7a81687fda32 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73732025-01-22T05:22:24.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c5bc9d99-4257-417e-8498-fb9126c5b8b2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73742025-01-22T05:22:24.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c5bc9d99-4257-417e-8498-fb9126c5b8b2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73752025-01-22T05:22:24.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c5bc9d99-4257-417e-8498-fb9126c5b8b2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73762025-01-22T05:22:25.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 64e70c8a-e822-4685-bda1-a99f0fd68db4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73772025-01-22T05:22:25.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 64e70c8a-e822-4685-bda1-a99f0fd68db4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73782025-01-22T05:22:25.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 64e70c8a-e822-4685-bda1-a99f0fd68db4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73792025-01-22T05:22:25.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 461 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = c9c9c531-7d92-4695-96f7-21750ae4f447 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
73802025-01-22T05:22:26.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f500900c-b291-4495-bf51-51c385522eb3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73812025-01-22T05:22:26.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f500900c-b291-4495-bf51-51c385522eb3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73822025-01-22T05:22:26.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f500900c-b291-4495-bf51-51c385522eb3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73832025-01-22T05:22:27.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 8c08fbd4-2a34-4a41-8659-7707f7ffd4c6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
73842025-01-22T05:22:27.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 8c08fbd4-2a34-4a41-8659-7707f7ffd4c6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
73852025-01-22T05:22:27.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 8c08fbd4-2a34-4a41-8659-7707f7ffd4c6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
73862025-01-22T05:22:27.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = c8590d13-1170-4591-b092-be4c009363d8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
73872025-01-22T05:22:27.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = c8590d13-1170-4591-b092-be4c009363d8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
73882025-01-22T05:22:27.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = c8590d13-1170-4591-b092-be4c009363d8 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
73892025-01-22T05:22:27.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0659b68c-e125-4f9d-b2e9-845d5b2e0700 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73902025-01-22T05:22:27.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0659b68c-e125-4f9d-b2e9-845d5b2e0700 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73912025-01-22T05:22:27.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0659b68c-e125-4f9d-b2e9-845d5b2e0700 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73922025-01-22T05:22:28.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 494bf0a9-379a-457f-8522-270dfda392c7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73932025-01-22T05:22:28.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 494bf0a9-379a-457f-8522-270dfda392c7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73942025-01-22T05:22:28.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 494bf0a9-379a-457f-8522-270dfda392c7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73952025-01-22T05:22:29.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1df97a23-8d8f-4984-a7f5-e2b6e430f2c3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73962025-01-22T05:22:29.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1df97a23-8d8f-4984-a7f5-e2b6e430f2c3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73972025-01-22T05:22:29.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1df97a23-8d8f-4984-a7f5-e2b6e430f2c3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73982025-01-22T05:22:30.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bfb044f5-c18a-458b-9f28-44f760d8ffe4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
73992025-01-22T05:22:30.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bfb044f5-c18a-458b-9f28-44f760d8ffe4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
74002025-01-22T05:22:30.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bfb044f5-c18a-458b-9f28-44f760d8ffe4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
74012025-01-22T05:22:31.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 94e3455e-1690-4c5d-a875-6957ba093565 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
74022025-01-22T05:22:31.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 94e3455e-1690-4c5d-a875-6957ba093565 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
74032025-01-22T05:22:31.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 94e3455e-1690-4c5d-a875-6957ba093565 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
74042025-01-22T05:22:32.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0c05714b-175b-450c-b0ba-d1322ac66196 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
74052025-01-22T05:22:32.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0c05714b-175b-450c-b0ba-d1322ac66196 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
74062025-01-22T05:22:32.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0c05714b-175b-450c-b0ba-d1322ac66196 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
74072025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
74082025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
74092025-01-22T05:22:32.824ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
74102025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74112025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
74122025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74132025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
74142025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
74152025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74162025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
74172025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74182025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
74192025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74202025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74212025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
74222025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
74232025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74242025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
74252025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
74262025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74272025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
74282025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
74292025-01-22T05:22:32.824ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:12:32.824313397 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
74302025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
74312025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
74322025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74332025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
74342025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
74352025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74362025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
74372025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
74382025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74392025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
74402025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
74412025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74422025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
74432025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74442025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
74452025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74462025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
74472025-01-22T05:22:32.824ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
74482025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.38\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
74492025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74502025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74512025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74522025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74532025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74542025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
74552025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74562025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74572025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
74582025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74592025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74602025-01-22T05:22:32.824ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74612025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
74622025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74632025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
74642025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74652025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74662025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
74672025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74682025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
74692025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
74702025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74712025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74722025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74732025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74742025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
74752025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74762025-01-22T05:22:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74772025-01-22T05:22:32.825ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11535, tv_nsec: 171719213 } })
74782025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74792025-01-22T05:22:32.825ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11535, tv_nsec: 171749434 } })
74802025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74812025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74822025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74832025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
74842025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74852025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74862025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74872025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74882025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74892025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
74902025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74912025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.137983ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
74922025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74932025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
74942025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.155933ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
74952025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74962025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74972025-01-22T05:22:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74982025-01-22T05:22:32.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74992025-01-22T05:22:32.827ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75002025-01-22T05:22:32.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75012025-01-22T05:22:32.828ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.786957ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75022025-01-22T05:22:32.829ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75032025-01-22T05:22:32.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75042025-01-22T05:22:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75052025-01-22T05:22:32.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75062025-01-22T05:22:32.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75072025-01-22T05:22:32.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
75082025-01-22T05:22:32.830ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75092025-01-22T05:22:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75102025-01-22T05:22:32.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75112025-01-22T05:22:32.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75122025-01-22T05:22:32.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75132025-01-22T05:22:32.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75142025-01-22T05:22:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75152025-01-22T05:22:32.835ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11535, tv_nsec: 182201227 } })
75162025-01-22T05:22:32.835ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
75172025-01-22T05:22:32.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75182025-01-22T05:22:32.836ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:12:32.824313397 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75192025-01-22T05:22:32.836ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.806611ms iteration = 13 status = {"expiration":"2025-01-22T05:12:32.824313397Z","pruned":[]}
75202025-01-22T05:22:32.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11535, tv_nsec: 183778029 } })
75212025-01-22T05:22:32.837ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
75222025-01-22T05:22:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75232025-01-22T05:22:32.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75242025-01-22T05:22:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75252025-01-22T05:22:32.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75262025-01-22T05:22:32.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75272025-01-22T05:22:32.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75282025-01-22T05:22:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75292025-01-22T05:22:32.845ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
75302025-01-22T05:22:32.845ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
75312025-01-22T05:22:32.845ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
75322025-01-22T05:22:32.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75332025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
75342025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75352025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
75362025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75372025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
75382025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75392025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75402025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75412025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
75422025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75432025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75442025-01-22T05:22:32.846ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75452025-01-22T05:22:32.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75462025-01-22T05:22:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75472025-01-22T05:22:32.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75482025-01-22T05:22:32.850ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75492025-01-22T05:22:32.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75502025-01-22T05:22:32.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75512025-01-22T05:22:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75522025-01-22T05:22:32.879ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75532025-01-22T05:22:32.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75542025-01-22T05:22:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
75552025-01-22T05:22:32.882ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75562025-01-22T05:22:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75572025-01-22T05:22:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75582025-01-22T05:22:32.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75592025-01-22T05:22:32.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75602025-01-22T05:22:32.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75612025-01-22T05:22:32.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75622025-01-22T05:22:32.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75632025-01-22T05:22:32.887ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75642025-01-22T05:22:32.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75652025-01-22T05:22:32.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75662025-01-22T05:22:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75672025-01-22T05:22:32.889ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75682025-01-22T05:22:32.889ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75692025-01-22T05:22:32.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75702025-01-22T05:22:32.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75712025-01-22T05:22:32.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75722025-01-22T05:22:32.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75732025-01-22T05:22:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75742025-01-22T05:22:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75752025-01-22T05:22:32.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75762025-01-22T05:22:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75772025-01-22T05:22:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75782025-01-22T05:22:32.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75792025-01-22T05:22:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75802025-01-22T05:22:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75812025-01-22T05:22:32.891ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75822025-01-22T05:22:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75832025-01-22T05:22:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75842025-01-22T05:22:32.891ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75852025-01-22T05:22:32.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75862025-01-22T05:22:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75872025-01-22T05:22:32.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75882025-01-22T05:22:32.893ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
75892025-01-22T05:22:32.893ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
75902025-01-22T05:22:32.893ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 68.480105ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
75912025-01-22T05:22:32.893ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75922025-01-22T05:22:32.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75932025-01-22T05:22:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75942025-01-22T05:22:32.894ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75952025-01-22T05:22:32.894ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
75962025-01-22T05:22:32.894ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
75972025-01-22T05:22:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75982025-01-22T05:22:32.894ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.501557ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
75992025-01-22T05:22:32.894ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 48.769424ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
76002025-01-22T05:22:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
76012025-01-22T05:22:32.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76022025-01-22T05:22:32.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76032025-01-22T05:22:32.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76042025-01-22T05:22:32.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76052025-01-22T05:22:32.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76062025-01-22T05:22:32.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76072025-01-22T05:22:32.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76082025-01-22T05:22:32.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76092025-01-22T05:22:32.901ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76102025-01-22T05:22:32.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76112025-01-22T05:22:32.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76122025-01-22T05:22:32.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76132025-01-22T05:22:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
76142025-01-22T05:22:32.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76152025-01-22T05:22:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76162025-01-22T05:22:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76172025-01-22T05:22:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76182025-01-22T05:22:32.907ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76192025-01-22T05:22:32.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76202025-01-22T05:22:32.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76212025-01-22T05:22:32.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76222025-01-22T05:22:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76232025-01-22T05:22:32.934ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11535, tv_nsec: 281299485 } })
76242025-01-22T05:22:32.935ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
76252025-01-22T05:22:32.937ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 112.696216ms iteration = 6 status = {"nsuccess":5}
76262025-01-22T05:22:32.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76272025-01-22T05:22:32.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76282025-01-22T05:22:32.944ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76292025-01-22T05:22:32.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76302025-01-22T05:22:32.950ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
76312025-01-22T05:22:32.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 112.295568ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
76322025-01-22T05:22:32.958ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76332025-01-22T05:22:32.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76342025-01-22T05:22:32.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76352025-01-22T05:22:32.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76362025-01-22T05:22:32.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 116.601605ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
76372025-01-22T05:22:32.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 141.539043ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76382025-01-22T05:22:32.966ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76392025-01-22T05:22:32.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76402025-01-22T05:22:32.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76412025-01-22T05:22:32.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76422025-01-22T05:22:32.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76432025-01-22T05:22:32.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76442025-01-22T05:22:32.971ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
76452025-01-22T05:22:32.971ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 147.497035ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
76462025-01-22T05:22:32.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76472025-01-22T05:22:32.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76482025-01-22T05:22:32.982ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76492025-01-22T05:22:32.982ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76502025-01-22T05:22:32.982ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76512025-01-22T05:22:32.982ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76522025-01-22T05:22:32.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76532025-01-22T05:22:32.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76542025-01-22T05:22:32.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76552025-01-22T05:22:32.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76562025-01-22T05:22:32.986ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76572025-01-22T05:22:32.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76582025-01-22T05:22:32.986ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76592025-01-22T05:22:32.986ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76602025-01-22T05:22:32.986ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76612025-01-22T05:22:32.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76622025-01-22T05:22:32.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76632025-01-22T05:22:32.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76642025-01-22T05:22:32.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76652025-01-22T05:22:32.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76662025-01-22T05:22:32.991ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76672025-01-22T05:22:32.991ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76682025-01-22T05:22:32.991ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76692025-01-22T05:22:32.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76702025-01-22T05:22:32.995ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76712025-01-22T05:22:32.995ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
76722025-01-22T05:22:32.996ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76732025-01-22T05:22:32.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76742025-01-22T05:22:32.996ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b1887d8-2548-44fd-8486-36b102e178fb", "content-length": "26", "date": "Wed, 22 Jan 2025 05:22:32 GMT"} })
76752025-01-22T05:22:32.996ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76762025-01-22T05:22:33.000ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76772025-01-22T05:22:33.007ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 182.781654ms iteration = 28 status = {"physical_disks_added":0}
76782025-01-22T05:22:33.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 183.442087ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76792025-01-22T05:22:33.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 173.620266ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76802025-01-22T05:22:33.023ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76812025-01-22T05:22:33.026ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76822025-01-22T05:22:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
76832025-01-22T05:22:33.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76842025-01-22T05:22:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76852025-01-22T05:22:33.029ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 205.315972ms iteration = 25 status = 0
76862025-01-22T05:22:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76872025-01-22T05:22:33.029ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76882025-01-22T05:22:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76892025-01-22T05:22:33.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76902025-01-22T05:22:33.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76912025-01-22T05:22:33.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76922025-01-22T05:22:33.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76932025-01-22T05:22:33.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 204.504056ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
76942025-01-22T05:22:33.052ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
76952025-01-22T05:22:33.052ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
76962025-01-22T05:22:33.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76972025-01-22T05:22:33.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76982025-01-22T05:22:33.058ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76992025-01-22T05:22:33.058ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77002025-01-22T05:22:33.058ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 233.643509ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77012025-01-22T05:22:33.064ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
77022025-01-22T05:22:33.066ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
77032025-01-22T05:22:33.066ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 242.207064ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77042025-01-22T05:22:33.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77052025-01-22T05:22:33.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77062025-01-22T05:22:33.097ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
77072025-01-22T05:22:33.097ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 272.548112ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
77082025-01-22T05:22:33.100ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
77092025-01-22T05:22:33.100ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77102025-01-22T05:22:33.101ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28b029c5-9f1a-4ce8-b12f-5b4baf20310f", "content-length": "26", "date": "Wed, 22 Jan 2025 05:22:32 GMT"} })
77112025-01-22T05:22:33.101ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77122025-01-22T05:22:33.102ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
77132025-01-22T05:22:33.148ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
77142025-01-22T05:22:33.148ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77152025-01-22T05:22:33.148ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14db9665-e4a1-42fd-88c9-a7fba6459728", "content-length": "26", "date": "Wed, 22 Jan 2025 05:22:32 GMT"} })
77162025-01-22T05:22:33.149ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77172025-01-22T05:22:33.150ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77182025-01-22T05:22:33.164ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
77192025-01-22T05:22:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 341.768362ms iteration = 25 status = {}
77202025-01-22T05:22:33.196ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/ccd81907-d22a-4133-9988-967a9223add1/state
77212025-01-22T05:22:33.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77222025-01-22T05:22:33.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77232025-01-22T05:22:33.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77242025-01-22T05:22:33.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77252025-01-22T05:22:33.234ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
77262025-01-22T05:22:33.235ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 410.775957ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
77272025-01-22T05:22:33.235ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77282025-01-22T05:22:33.235ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77292025-01-22T05:22:33.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77302025-01-22T05:22:33.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77312025-01-22T05:22:33.237ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77322025-01-22T05:22:33.237ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77332025-01-22T05:22:33.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77342025-01-22T05:22:33.240ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
77352025-01-22T05:22:33.240ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
77362025-01-22T05:22:33.240ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
77372025-01-22T05:22:33.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 416.650588ms iteration = 13 status = {"generation":2}
77382025-01-22T05:22:33.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77392025-01-22T05:22:33.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77402025-01-22T05:22:33.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77412025-01-22T05:22:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77422025-01-22T05:22:33.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77432025-01-22T05:22:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77442025-01-22T05:22:33.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77452025-01-22T05:22:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77462025-01-22T05:22:33.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77472025-01-22T05:22:33.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77482025-01-22T05:22:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77492025-01-22T05:22:33.246ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
77502025-01-22T05:22:33.246ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77512025-01-22T05:22:33.246ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
77522025-01-22T05:22:33.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 422.193371ms iteration = 13 status = {"generation":1}
77532025-01-22T05:22:33.251ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
77542025-01-22T05:22:33.252ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "25ba35ca-8f07-49c8-bf4c-5c5b01d2fd15", "date": "Wed, 22 Jan 2025 05:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77552025-01-22T05:22:33.252ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77562025-01-22T05:22:33.253ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ae47ca64-12dc-474a-b2d8-a626e656ff7a", "date": "Wed, 22 Jan 2025 05:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77572025-01-22T05:22:33.253ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77582025-01-22T05:22:33.255ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77592025-01-22T05:22:33.255ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 430.884628ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
77602025-01-22T05:22:33.263ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77612025-01-22T05:22:33.263ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f63b2509-4078-4f1f-8e9c-2f71ca2a26ec", "content-length": "1", "date": "Wed, 22 Jan 2025 05:22:33 GMT"} })
77622025-01-22T05:22:33.265ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77632025-01-22T05:22:33.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77642025-01-22T05:22:33.267ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 443.606887ms iteration = 25 status = null
77652025-01-22T05:22:33.272ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
77662025-01-22T05:22:33.272ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7a906314-43ef-44c9-8f6d-882d9de76500", "date": "Wed, 22 Jan 2025 05:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77672025-01-22T05:22:33.272ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77682025-01-22T05:22:33.274ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c3533d29-2d3d-44a7-a670-183d0e1dc80c", "date": "Wed, 22 Jan 2025 05:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77692025-01-22T05:22:33.274ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77702025-01-22T05:22:33.278ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "64a43dfb-df14-4f01-b8e1-8937870d4420", "date": "Wed, 22 Jan 2025 05:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77712025-01-22T05:22:33.278ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77722025-01-22T05:22:33.280ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
77732025-01-22T05:22:33.280ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 456.140312ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
77742025-01-22T05:22:33.330ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d9e60be-7406-4a04-a9f0-32d2189738f2", "content-length": "585", "date": "Wed, 22 Jan 2025 05:22:32 GMT"} })
77752025-01-22T05:22:33.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77762025-01-22T05:22:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77772025-01-22T05:22:33.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77782025-01-22T05:22:33.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77792025-01-22T05:22:33.358ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77802025-01-22T05:22:33.359ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "460fb236-c7bd-4a9a-a124-49efa5294b5c", "content-length": "811", "date": "Wed, 22 Jan 2025 05:22:33 GMT"} })
77812025-01-22T05:22:33.359ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(15156480) }} sled = buskin
77822025-01-22T05:22:33.359ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
77832025-01-22T05:22:33.359ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
77842025-01-22T05:22:33.360ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
77852025-01-22T05:22:33.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77862025-01-22T05:22:33.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77872025-01-22T05:22:33.361ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 537.214773ms iteration = 25 status = {}
77882025-01-22T05:22:33.373ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77892025-01-22T05:22:33.374ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fabf62a-8be8-478a-9d49-e6630f2849af", "content-length": "134", "date": "Wed, 22 Jan 2025 05:22:33 GMT"} })
77902025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77912025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
77922025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77932025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77942025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77952025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77962025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77972025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77982025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77992025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78002025-01-22T05:22:33.374ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
78012025-01-22T05:22:33.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78022025-01-22T05:22:33.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78032025-01-22T05:22:33.376ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78042025-01-22T05:22:33.376ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "45a5f0a6-0234-4408-88d7-5d6ed25f8745", "content-length": "2", "date": "Wed, 22 Jan 2025 05:22:33 GMT"} })
78052025-01-22T05:22:33.376ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78062025-01-22T05:22:33.376ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4028733e-cb4d-4655-aae5-f0647f122eec", "content-length": "51", "date": "Wed, 22 Jan 2025 05:22:33 GMT"} })
78072025-01-22T05:22:33.376ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
78082025-01-22T05:22:33.377ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78092025-01-22T05:22:33.403ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {5c22177c-f28c-49d3-a2b3-6a161a0ef3f0: {10.151.1.176: {86c0ac83-7319-4c6c-b03c-9f41cebcb41a}, 10.151.1.175: {86c0ac83-7319-4c6c-b03c-9f41cebcb41a}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
78102025-01-22T05:22:33.403ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78112025-01-22T05:22:33.474ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1600f1f1-14df-42bb-a186-56c7a7e6e914", "date": "Wed, 22 Jan 2025 05:22:33 GMT"} })
78122025-01-22T05:22:33.474ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
78132025-01-22T05:22:33.474ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78142025-01-22T05:22:33.474ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c207229f-58eb-45e5-90c1-9edf0c39a340", "date": "Wed, 22 Jan 2025 05:22:33 GMT"} })
78152025-01-22T05:22:33.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78162025-01-22T05:22:33.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78172025-01-22T05:22:33.475ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f0a398b-f894-4715-8fed-ad848f1fe03c", "content-length": "682", "date": "Wed, 22 Jan 2025 05:22:33 GMT"} })
78182025-01-22T05:22:33.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78192025-01-22T05:22:33.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78202025-01-22T05:22:33.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78212025-01-22T05:22:33.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78222025-01-22T05:22:33.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78232025-01-22T05:22:33.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78242025-01-22T05:22:33.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78252025-01-22T05:22:33.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78262025-01-22T05:22:33.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78272025-01-22T05:22:33.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78282025-01-22T05:22:33.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78292025-01-22T05:22:33.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78302025-01-22T05:22:33.485ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78312025-01-22T05:22:33.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78322025-01-22T05:22:33.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78332025-01-22T05:22:33.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78342025-01-22T05:22:33.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78352025-01-22T05:22:33.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78362025-01-22T05:22:33.493ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 669.489247ms iteration = 25 status = {}
78372025-01-22T05:22:33.496ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78382025-01-22T05:22:33.496ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78392025-01-22T05:22:33.496ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78402025-01-22T05:22:33.496ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2f44435d-2853-4b4e-9d17-f2087961a241", "date": "Wed, 22 Jan 2025 05:22:33 GMT"} })
78412025-01-22T05:22:33.498ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 673.389297ms iteration = 25 status = {}
78422025-01-22T05:22:33.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4e3bb4ca-d426-4942-adff-eeebdba74595 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78432025-01-22T05:22:33.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4e3bb4ca-d426-4942-adff-eeebdba74595 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78442025-01-22T05:22:33.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4e3bb4ca-d426-4942-adff-eeebdba74595 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78452025-01-22T05:22:34.436ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/ccd81907-d22a-4133-9988-967a9223add1/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a68636b-bb81-49ad-b8fd-24b0a3c81c82", "content-length": "131", "date": "Wed, 22 Jan 2025 05:22:34 GMT"} })
78462025-01-22T05:22:34.443ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 sled_id = af8308ab-46c4-4104-b864-f43b03f195e3 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-22T05:22:26.507739449Z }, migration_in: None, migration_out: None } vmm_id = ccd81907-d22a-4133-9988-967a9223add1
78472025-01-22T05:22:34.443ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2078 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ccd81907-d22a-4133-9988-967a9223add1 sled_id = af8308ab-46c4-4104-b864-f43b03f195e3 vmm_id = ccd81907-d22a-4133-9988-967a9223add1 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-22T05:22:26.507739449Z }
78482025-01-22T05:22:34.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 roles = RoleSet { roles: {} } sled_id = af8308ab-46c4-4104-b864-f43b03f195e3 vmm_id = ccd81907-d22a-4133-9988-967a9223add1
78492025-01-22T05:22:34.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 resource = Database result = Ok(()) sled_id = af8308ab-46c4-4104-b864-f43b03f195e3 vmm_id = ccd81907-d22a-4133-9988-967a9223add1
78502025-01-22T05:22:34.452ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ccd81907-d22a-4133-9988-967a9223add1 remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b99ce7d6-7a6a-4f24-86b3-34e6f7e70187 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-22T05:22:34.436639070Z }
78512025-01-22T05:22:34.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b99ce7d6-7a6a-4f24-86b3-34e6f7e70187 roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
78522025-01-22T05:22:34.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b99ce7d6-7a6a-4f24-86b3-34e6f7e70187 resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
78532025-01-22T05:22:34.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57342 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b99ce7d6-7a6a-4f24-86b3-34e6f7e70187 response_code = 204 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
78542025-01-22T05:22:34.494ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ccd81907-d22a-4133-9988-967a9223add1 remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ed186bd-0072-4e79-899c-43c6fb32954f uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-22T05:22:34.494581550Z }
78552025-01-22T05:22:34.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ed186bd-0072-4e79-899c-43c6fb32954f roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
78562025-01-22T05:22:34.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ed186bd-0072-4e79-899c-43c6fb32954f resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
78572025-01-22T05:22:34.495ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
78582025-01-22T05:22:34.497ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.672306304s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
78592025-01-22T05:22:34.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36673 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ed186bd-0072-4e79-899c-43c6fb32954f response_code = 204 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
78602025-01-22T05:22:34.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 859184d1-97ed-47b7-8f2f-6144c380f85d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78612025-01-22T05:22:34.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 859184d1-97ed-47b7-8f2f-6144c380f85d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78622025-01-22T05:22:34.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 859184d1-97ed-47b7-8f2f-6144c380f85d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78632025-01-22T05:22:35.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0f67d159-5538-4de5-abec-d7aa0215bb86 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78642025-01-22T05:22:35.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0f67d159-5538-4de5-abec-d7aa0215bb86 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78652025-01-22T05:22:35.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0f67d159-5538-4de5-abec-d7aa0215bb86 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78662025-01-22T05:22:35.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 658 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = b215503a-e786-4379-87d0-be7710989450 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
78672025-01-22T05:22:36.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 54e4ea1b-ad21-4770-a0bf-ae431ca73686 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78682025-01-22T05:22:36.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 54e4ea1b-ad21-4770-a0bf-ae431ca73686 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78692025-01-22T05:22:36.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 54e4ea1b-ad21-4770-a0bf-ae431ca73686 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78702025-01-22T05:22:37.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1925fda-a8eb-4463-8135-14b45581a6da roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78712025-01-22T05:22:37.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1925fda-a8eb-4463-8135-14b45581a6da resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78722025-01-22T05:22:37.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a1925fda-a8eb-4463-8135-14b45581a6da response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78732025-01-22T05:22:38.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 36dfeaff-aced-483f-aa37-3f40d3d7274e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78742025-01-22T05:22:38.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 36dfeaff-aced-483f-aa37-3f40d3d7274e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78752025-01-22T05:22:38.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 36dfeaff-aced-483f-aa37-3f40d3d7274e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78762025-01-22T05:22:39.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2e3bbe99-fe05-4488-9b3a-a40a67d7fd78 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78772025-01-22T05:22:39.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2e3bbe99-fe05-4488-9b3a-a40a67d7fd78 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78782025-01-22T05:22:39.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2e3bbe99-fe05-4488-9b3a-a40a67d7fd78 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78792025-01-22T05:22:40.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e3cdb98f-dec9-47c8-b3ab-16396e7cc276 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78802025-01-22T05:22:40.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e3cdb98f-dec9-47c8-b3ab-16396e7cc276 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78812025-01-22T05:22:40.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e3cdb98f-dec9-47c8-b3ab-16396e7cc276 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78822025-01-22T05:22:41.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b416203f-e7b7-4feb-8309-3137a5ced066 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78832025-01-22T05:22:41.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b416203f-e7b7-4feb-8309-3137a5ced066 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78842025-01-22T05:22:41.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b416203f-e7b7-4feb-8309-3137a5ced066 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
78852025-01-22T05:22:42.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
78862025-01-22T05:22:42.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78872025-01-22T05:22:42.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78882025-01-22T05:22:42.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
78892025-01-22T05:22:42.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78902025-01-22T05:22:42.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78912025-01-22T05:22:42.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78922025-01-22T05:22:42.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78932025-01-22T05:22:42.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78942025-01-22T05:22:42.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78952025-01-22T05:22:42.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78962025-01-22T05:22:42.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78972025-01-22T05:22:42.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78982025-01-22T05:22:42.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78992025-01-22T05:22:42.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79002025-01-22T05:22:42.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
79012025-01-22T05:22:42.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79022025-01-22T05:22:42.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79032025-01-22T05:22:42.844ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
79042025-01-22T05:22:42.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.708732ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
79052025-01-22T05:22:42.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.582753ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79062025-01-22T05:22:42.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3fad0963-f873-4bfd-a9f5-5aed34a62553 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79072025-01-22T05:22:42.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3fad0963-f873-4bfd-a9f5-5aed34a62553 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79082025-01-22T05:22:42.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3fad0963-f873-4bfd-a9f5-5aed34a62553 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79092025-01-22T05:22:43.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 60fd6f50-cecf-45df-9a2e-db3db18f7130 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79102025-01-22T05:22:43.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 60fd6f50-cecf-45df-9a2e-db3db18f7130 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79112025-01-22T05:22:43.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 60fd6f50-cecf-45df-9a2e-db3db18f7130 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79122025-01-22T05:22:44.179ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ccd81907-d22a-4133-9988-967a9223add1 remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5163d5e-9ad5-48b8-ba9e-e12c3c8b3c31 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-22T05:22:44.179562692Z }
79132025-01-22T05:22:44.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5163d5e-9ad5-48b8-ba9e-e12c3c8b3c31 roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79142025-01-22T05:22:44.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5163d5e-9ad5-48b8-ba9e-e12c3c8b3c31 resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79152025-01-22T05:22:44.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38238 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5163d5e-9ad5-48b8-ba9e-e12c3c8b3c31 response_code = 204 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79162025-01-22T05:22:44.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6b27c168-9e8a-4ec9-a25f-acb604e95533 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79172025-01-22T05:22:44.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6b27c168-9e8a-4ec9-a25f-acb604e95533 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79182025-01-22T05:22:44.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6b27c168-9e8a-4ec9-a25f-acb604e95533 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79192025-01-22T05:22:45.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 9a1ea102-ff7a-4613-a1c2-72e30309ae13 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
79202025-01-22T05:22:45.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 9a1ea102-ff7a-4613-a1c2-72e30309ae13 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
79212025-01-22T05:22:45.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 9a1ea102-ff7a-4613-a1c2-72e30309ae13 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
79222025-01-22T05:22:45.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 37677ffc-96c7-4a96-b9c4-992dff822292 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
79232025-01-22T05:22:45.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 37677ffc-96c7-4a96-b9c4-992dff822292 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
79242025-01-22T05:22:45.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 37677ffc-96c7-4a96-b9c4-992dff822292 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
79252025-01-22T05:22:45.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 895c15a8-2122-4e1d-a4dc-29f42dd8ec68 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79262025-01-22T05:22:45.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 895c15a8-2122-4e1d-a4dc-29f42dd8ec68 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79272025-01-22T05:22:45.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 895c15a8-2122-4e1d-a4dc-29f42dd8ec68 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
79282025-01-22T05:22:45.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 594 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 5e7f29a2-9935-4fae-b876-3ffbc42f96c6 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
79292025-01-22T05:22:46.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 32f7790e-0d94-4410-83b1-7170ffa4c6f7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
79302025-01-22T05:22:46.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 32f7790e-0d94-4410-83b1-7170ffa4c6f7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
79312025-01-22T05:22:46.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 32f7790e-0d94-4410-83b1-7170ffa4c6f7 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
79322025-01-22T05:22:46.641ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ccd81907-d22a-4133-9988-967a9223add1 remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-22T05:22:46.641112253Z }
79332025-01-22T05:22:46.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79342025-01-22T05:22:46.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79352025-01-22T05:22:46.650ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = ccd81907-d22a-4133-9988-967a9223add1 remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1 vmm_needs_update = true
79362025-01-22T05:22:46.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79372025-01-22T05:22:46.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79382025-01-22T05:22:46.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79392025-01-22T05:22:46.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79402025-01-22T05:22:46.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79412025-01-22T05:22:46.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79422025-01-22T05:22:46.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79432025-01-22T05:22:46.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79442025-01-22T05:22:46.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79452025-01-22T05:22:46.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79462025-01-22T05:22:46.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79472025-01-22T05:22:46.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79482025-01-22T05:22:46.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79492025-01-22T05:22:46.665ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 98f37959-e334-4e44-8a28-8cd3a4681175, lookup_type: ById(98f37959-e334-4e44-8a28-8cd3a4681175) }, key: 238699cc-b260-42a2-804d-c3c5f6290a1e, lookup_type: ById(238699cc-b260-42a2-804d-c3c5f6290a1e) }, key: 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3, lookup_type: ById(55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3) } result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79502025-01-22T05:22:46.674ZINFOnexus (dropshot_internal): starting update saga for 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1545 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-22T05:22:46.641112253Z }
79512025-01-22T05:22:46.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35269 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 response_code = 204 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79522025-01-22T05:22:46.677ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ccd81907-d22a-4133-9988-967a9223add1 remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c94c418-0cf9-4345-830f-c5d90edcdf1b uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-22T05:22:46.641112253Z }
79532025-01-22T05:22:46.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c94c418-0cf9-4345-830f-c5d90edcdf1b roles = RoleSet { roles: {} } uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79542025-01-22T05:22:46.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c94c418-0cf9-4345-830f-c5d90edcdf1b resource = Database result = Ok(()) uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79552025-01-22T05:22:46.678ZDEBGnexus (dropshot_internal): preparing instance-update saga for 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2088d4da-5272-49b0-b0e8-55af4ac9a776 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79562025-01-22T05:22:46.678ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update
79572025-01-22T05:22:46.681ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3","lookup_type":{"ById":"55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3"},"parent":{"key":"238699cc-b260-42a2-804d-c3c5f6290a1e","lookup_type":{"ById":"238699cc-b260-42a2-804d-c3c5f6290a1e"},"parent":{"key":"98f37959-e334-4e44-8a28-8cd3a4681175","lookup_type":{"ById":"98f37959-e334-4e44-8a28-8cd3a4681175"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
79582025-01-22T05:22:46.681ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update
79592025-01-22T05:22:46.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4408 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6c94c418-0cf9-4345-830f-c5d90edcdf1b response_code = 204 uri = /vmms/ccd81907-d22a-4133-9988-967a9223add1
79602025-01-22T05:22:46.714ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update
79612025-01-22T05:22:46.714ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
79622025-01-22T05:22:46.719ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
79632025-01-22T05:22:46.721ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
79642025-01-22T05:22:46.725ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
79652025-01-22T05:22:46.725ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
79662025-01-22T05:22:46.729ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
79672025-01-22T05:22:46.729ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
79682025-01-22T05:22:46.733ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
79692025-01-22T05:22:46.733ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cb3541c4-0bff-43c7-8fe0-a7e0644f8a97")) node_id = 0 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
79702025-01-22T05:22:46.737ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
79712025-01-22T05:22:46.737ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
79722025-01-22T05:22:46.755ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update
79732025-01-22T05:22:46.755ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79742025-01-22T05:22:46.755ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79752025-01-22T05:22:46.758ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79762025-01-22T05:22:46.758ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79772025-01-22T05:22:46.759ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79782025-01-22T05:22:46.759ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79792025-01-22T05:22:46.761ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79802025-01-22T05:22:46.762ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79812025-01-22T05:22:46.763ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79822025-01-22T05:22:46.763ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79832025-01-22T05:22:46.764ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79842025-01-22T05:22:46.764ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79852025-01-22T05:22:46.766ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79862025-01-22T05:22:46.769ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 98f37959-e334-4e44-8a28-8cd3a4681175, lookup_type: ById(98f37959-e334-4e44-8a28-8cd3a4681175) }, key: 238699cc-b260-42a2-804d-c3c5f6290a1e, lookup_type: ById(238699cc-b260-42a2-804d-c3c5f6290a1e) }, key: 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3, lookup_type: ById(55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3) } result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79872025-01-22T05:22:46.769ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance updater_id = cb3541c4-0bff-43c7-8fe0-a7e0644f8a97
79882025-01-22T05:22:46.769ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79892025-01-22T05:22:46.769ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79902025-01-22T05:22:46.782ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance updater_id = cb3541c4-0bff-43c7-8fe0-a7e0644f8a97
79912025-01-22T05:22:46.782ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79922025-01-22T05:22:46.782ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance
79932025-01-22T05:22:46.787ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 locked_gen = Generation(Generation(2)) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = LockInstance updater_id = cb3541c4-0bff-43c7-8fe0-a7e0644f8a97
79942025-01-22T05:22:46.787ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
79952025-01-22T05:22:46.787ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("cb3541c4-0bff-43c7-8fe0-a7e0644f8a97")}) node_id = 1 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
79962025-01-22T05:22:46.791ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
79972025-01-22T05:22:46.791ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
79982025-01-22T05:22:46.806ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
79992025-01-22T05:22:46.806ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80002025-01-22T05:22:46.808ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80012025-01-22T05:22:46.808ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80022025-01-22T05:22:46.809ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80032025-01-22T05:22:46.809ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80042025-01-22T05:22:46.811ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80052025-01-22T05:22:46.814ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 98f37959-e334-4e44-8a28-8cd3a4681175, lookup_type: ById(98f37959-e334-4e44-8a28-8cd3a4681175) }, key: 238699cc-b260-42a2-804d-c3c5f6290a1e, lookup_type: ById(238699cc-b260-42a2-804d-c3c5f6290a1e) }, key: 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3, lookup_type: ById(55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3) } result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80062025-01-22T05:22:46.814ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80072025-01-22T05:22:46.814ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
80082025-01-22T05:22:46.825ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: ccd81907-d22a-4133-9988-967a9223add1, time_created: 2025-01-22T05:22:25.990521Z, time_deleted: None, instance_id: 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3, sled_id: af8308ab-46c4-4104-b864-f43b03f195e3, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-22T05:22:46.641112Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-22T05:22:23.854487Z, gen: Generation(Generation(3)), propolis_id: Some(ccd81907-d22a-4133-9988-967a9223add1), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(ccd81907-d22a-4133-9988-967a9223add1 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-22T05:22:46.820568399Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
80092025-01-22T05:22:46.829ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80102025-01-22T05:22:46.829ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"ccd81907-d22a-4133-9988-967a9223add1"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3","lookup_type":{"ById":"55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3"},"parent":{"key":"238699cc-b260-42a2-804d-c3c5f6290a1e","lookup_type":{"ById":"238699cc-b260-42a2-804d-c3c5f6290a1e"},"parent":{"key":"98f37959-e334-4e44-8a28-8cd3a4681175","lookup_type":{"ById":"98f37959-e334-4e44-8a28-8cd3a4681175"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"cb3541c4-0bff-43c7-8fe0-a7e0644f8a97"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"238699cc-b260-42a2-804d-c3c5f6290a1e","ram_diff":1073741824},"destroy_active_vmm":"ccd81907-d22a-4133-9988-967a9223add1","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-22T05:22:46.820568399Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80112025-01-22T05:22:46.829ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80122025-01-22T05:22:46.836ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80132025-01-22T05:22:46.836ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80142025-01-22T05:22:46.836ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80152025-01-22T05:22:46.836ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80162025-01-22T05:22:46.840ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80172025-01-22T05:22:46.840ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80182025-01-22T05:22:46.844ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80192025-01-22T05:22:46.844ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80202025-01-22T05:22:46.847ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80212025-01-22T05:22:46.847ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5106841f-7caa-467e-9ce4-71d5389a1a99")) node_id = 0 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80222025-01-22T05:22:46.851ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80232025-01-22T05:22:46.851ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80242025-01-22T05:22:46.857ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 parent_lock = UpdaterLock { updater_id: cb3541c4-0bff-43c7-8fe0-a7e0644f8a97, locked_gen: Generation(Generation(2)) } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80252025-01-22T05:22:46.857ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = BecomeUpdater
80262025-01-22T05:22:46.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = BecomeUpdater
80272025-01-22T05:22:46.869ZDEBGnexus (SagaExecutor): inherited lock from cb3541c4-0bff-43c7-8fe0-a7e0644f8a97 to 5106841f-7caa-467e-9ce4-71d5389a1a99 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = cb3541c4-0bff-43c7-8fe0-a7e0644f8a97 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = BecomeUpdater updater_id = 5106841f-7caa-467e-9ce4-71d5389a1a99
80282025-01-22T05:22:46.869ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80292025-01-22T05:22:46.869ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80302025-01-22T05:22:46.869ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("5106841f-7caa-467e-9ce4-71d5389a1a99")}) node_id = 1 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80312025-01-22T05:22:46.872ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80322025-01-22T05:22:46.872ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80332025-01-22T05:22:46.876ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80342025-01-22T05:22:46.876ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80352025-01-22T05:22:46.879ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80362025-01-22T05:22:46.879ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80372025-01-22T05:22:46.883ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80382025-01-22T05:22:46.883ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3
80392025-01-22T05:22:46.885ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UpdateNetworkConfig
80402025-01-22T05:22:46.885ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UpdateNetworkConfig
80412025-01-22T05:22:46.888ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UpdateNetworkConfig
80422025-01-22T05:22:46.888ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UpdateNetworkConfig
80432025-01-22T05:22:46.891ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
80442025-01-22T05:22:46.891ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UpdateNetworkConfig
80452025-01-22T05:22:46.891ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UpdateNetworkConfig
80462025-01-22T05:22:46.893ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
80472025-01-22T05:22:46.893ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
80482025-01-22T05:22:46.893ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
80492025-01-22T05:22:46.894ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
80502025-01-22T05:22:46.895ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
80512025-01-22T05:22:46.895ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
80522025-01-22T05:22:46.896ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
80532025-01-22T05:22:46.899ZDEBGnexus: notifying dendrite of updates instance_id = Some(55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 (instance)) switch = switch0
80542025-01-22T05:22:46.900ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11549, tv_nsec: 247124589 } })
80552025-01-22T05:22:46.900ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1104
80562025-01-22T05:22:46.931ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
80572025-01-22T05:22:46.931ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80582025-01-22T05:22:46.931ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad63bf5e-99db-405e-91b8-12fbc0e2eeb5", "content-length": "26", "date": "Wed, 22 Jan 2025 05:22:46 GMT"} })
80592025-01-22T05:22:46.931ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80602025-01-22T05:22:46.932ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80612025-01-22T05:22:46.961ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
80622025-01-22T05:22:46.962ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "3824ecd6-f699-43b0-b5df-db41d0e85ba8", "content-length": "4", "date": "Wed, 22 Jan 2025 05:22:46 GMT"} })
80632025-01-22T05:22:46.963ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80642025-01-22T05:22:46.963ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80652025-01-22T05:22:46.967ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80662025-01-22T05:22:46.967ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80672025-01-22T05:22:46.972ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
80682025-01-22T05:22:46.972ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
80692025-01-22T05:22:46.985ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-22T05:22:46.975219Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 238699cc-b260-42a2-804d-c3c5f6290a1e, time_modified: Some(2025-01-22T05:22:46.975219Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 98f37959-e334-4e44-8a28-8cd3a4681175, time_modified: Some(2025-01-22T05:22:46.975219Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80702025-01-22T05:22:46.985ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80712025-01-22T05:22:46.985ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80722025-01-22T05:22:46.989ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80732025-01-22T05:22:46.989ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80742025-01-22T05:22:46.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ad42d86-ef92-4929-8142-7a7016290b1f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
80752025-01-22T05:22:46.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ad42d86-ef92-4929-8142-7a7016290b1f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
80762025-01-22T05:22:46.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6ad42d86-ef92-4929-8142-7a7016290b1f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
80772025-01-22T05:22:46.995ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80782025-01-22T05:22:46.995ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UnassignOximeterProducer
80792025-01-22T05:22:46.995ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UnassignOximeterProducer
80802025-01-22T05:22:47.002ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0 producer_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80812025-01-22T05:22:47.002ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UnassignOximeterProducer
80822025-01-22T05:22:47.002ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = UnassignOximeterProducer
80832025-01-22T05:22:47.039ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80842025-01-22T05:22:47.041ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3
80852025-01-22T05:22:47.061ZDEBGnexus (SagaExecutor): client response oximeter-collector = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3", status: 204, headers: {"x-request-id": "7766b859-9547-426a-b04a-96261b715565", "date": "Wed, 22 Jan 2025 05:22:47 GMT"} }) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80862025-01-22T05:22:47.061ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0 producer_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80872025-01-22T05:22:47.062ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80882025-01-22T05:22:47.063ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80892025-01-22T05:22:47.067ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80902025-01-22T05:22:47.067ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
80912025-01-22T05:22:47.070ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 lock = UpdaterLock { updater_id: 5106841f-7caa-467e-9ce4-71d5389a1a99, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-22T05:22:46.820568399Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80922025-01-22T05:22:47.070ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = CommitInstanceUpdates
80932025-01-22T05:22:47.071ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = CommitInstanceUpdates
80942025-01-22T05:22:47.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 80844c2a-eb1c-44d5-8e98-0b5eafd7dff5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
80952025-01-22T05:22:47.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 80844c2a-eb1c-44d5-8e98-0b5eafd7dff5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
80962025-01-22T05:22:47.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 80844c2a-eb1c-44d5-8e98-0b5eafd7dff5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
80972025-01-22T05:22:47.156ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 new_runtime = InstanceRuntimeState { time_updated: 2025-01-22T05:22:46.820568399Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
80982025-01-22T05:22:47.156ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
80992025-01-22T05:22:47.156ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81002025-01-22T05:22:47.156ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
81012025-01-22T05:22:47.156ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
81022025-01-22T05:22:47.156ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
81032025-01-22T05:22:47.156ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81042025-01-22T05:22:47.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81052025-01-22T05:22:47.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81062025-01-22T05:22:47.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81072025-01-22T05:22:47.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81082025-01-22T05:22:47.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81092025-01-22T05:22:47.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81102025-01-22T05:22:47.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81112025-01-22T05:22:47.161ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81122025-01-22T05:22:47.161ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81132025-01-22T05:22:47.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81142025-01-22T05:22:47.164ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81152025-01-22T05:22:47.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81162025-01-22T05:22:47.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81172025-01-22T05:22:47.164ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81182025-01-22T05:22:47.164ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ccd81907-d22a-4133-9988-967a9223add1")}) node_id = 7 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81192025-01-22T05:22:47.168ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81202025-01-22T05:22:47.168ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81212025-01-22T05:22:47.172ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81222025-01-22T05:22:47.172ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81232025-01-22T05:22:47.176ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81242025-01-22T05:22:47.176ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81252025-01-22T05:22:47.183ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 propolis_id = ccd81907-d22a-4133-9988-967a9223add1 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
81262025-01-22T05:22:47.183ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ReleaseSledResources
81272025-01-22T05:22:47.184ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ReleaseSledResources
81282025-01-22T05:22:47.200ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81292025-01-22T05:22:47.200ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81302025-01-22T05:22:47.204ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81312025-01-22T05:22:47.204ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81322025-01-22T05:22:47.207ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 propolis_id = ccd81907-d22a-4133-9988-967a9223add1 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
81332025-01-22T05:22:47.207ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = MarkVmmDeleted
81342025-01-22T05:22:47.207ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = MarkVmmDeleted
81352025-01-22T05:22:47.220ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81362025-01-22T05:22:47.220ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81372025-01-22T05:22:47.225ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81382025-01-22T05:22:47.225ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81392025-01-22T05:22:47.231ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81402025-01-22T05:22:47.231ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81412025-01-22T05:22:47.235ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81422025-01-22T05:22:47.235ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81432025-01-22T05:22:47.238ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81442025-01-22T05:22:47.238ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81452025-01-22T05:22:47.241ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81462025-01-22T05:22:47.241ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81472025-01-22T05:22:47.253ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81482025-01-22T05:22:47.253ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81492025-01-22T05:22:47.253ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "147357f7-832d-4093-ae0e-aa0d67d3884a", "content-length": "372", "date": "Wed, 22 Jan 2025 05:22:47 GMT"} })
81502025-01-22T05:22:47.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81512025-01-22T05:22:47.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81522025-01-22T05:22:47.255ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81532025-01-22T05:22:47.255ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81542025-01-22T05:22:47.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81552025-01-22T05:22:47.256ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81562025-01-22T05:22:47.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81572025-01-22T05:22:47.260ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 98f37959-e334-4e44-8a28-8cd3a4681175, lookup_type: ById(98f37959-e334-4e44-8a28-8cd3a4681175) }, key: 238699cc-b260-42a2-804d-c3c5f6290a1e, lookup_type: ById(238699cc-b260-42a2-804d-c3c5f6290a1e) }, key: 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3, lookup_type: ById(55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3) } result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81582025-01-22T05:22:47.260ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81592025-01-22T05:22:47.260ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_node = ChainSuccessorSaga
81602025-01-22T05:22:47.265ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 karmic_state = WillReincarnate needs_reincarnation = false saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update
81612025-01-22T05:22:47.265ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81622025-01-22T05:22:47.265ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81632025-01-22T05:22:47.269ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81642025-01-22T05:22:47.269ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81652025-01-22T05:22:47.280ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81662025-01-22T05:22:47.280ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81672025-01-22T05:22:47.285ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81682025-01-22T05:22:47.285ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5
81692025-01-22T05:22:47.311ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
81702025-01-22T05:22:47.311ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81712025-01-22T05:22:47.311ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eecf34ea-a5f8-42fa-a6f4-4a59734eaf6f", "date": "Wed, 22 Jan 2025 05:22:47 GMT"} })
81722025-01-22T05:22:47.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81732025-01-22T05:22:47.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81742025-01-22T05:22:47.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81752025-01-22T05:22:47.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81762025-01-22T05:22:47.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81772025-01-22T05:22:47.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81782025-01-22T05:22:47.320ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81792025-01-22T05:22:47.320ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81802025-01-22T05:22:47.321ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e858f763-aa9b-45ce-ba66-7494a82392a7", "date": "Wed, 22 Jan 2025 05:22:47 GMT"} })
81812025-01-22T05:22:47.323ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 166.036652ms iteration = 26 status = {}
81822025-01-22T05:22:47.328ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81832025-01-22T05:22:47.333ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 saga_name = instance-update saga_result = SagaResult { saga_id: eb673bc4-746c-4acb-a90e-ad2043bb75c5, saga_log: SagaLog { saga_id: eb673bc4-746c-4acb-a90e-ad2043bb75c5, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("5106841f-7caa-467e-9ce4-71d5389a1a99")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("5106841f-7caa-467e-9ce4-71d5389a1a99")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ccd81907-d22a-4133-9988-967a9223add1")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ccd81907-d22a-4133-9988-967a9223add1")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("5106841f-7caa-467e-9ce4-71d5389a1a99"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("5106841f-7caa-467e-9ce4-71d5389a1a99")}} }) }
81842025-01-22T05:22:47.333ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = eb673bc4-746c-4acb-a90e-ad2043bb75c5 instance_id = 55b9f21c-c4b6-40b4-9d0b-0627ad5d69f3 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update
81852025-01-22T05:22:47.333ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81862025-01-22T05:22:47.333ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
81872025-01-22T05:22:47.337ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81882025-01-22T05:22:47.337ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
81892025-01-22T05:22:47.340ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81902025-01-22T05:22:47.340ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
81912025-01-22T05:22:47.344ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
81922025-01-22T05:22:47.344ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e
81932025-01-22T05:22:47.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81942025-01-22T05:22:47.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81952025-01-22T05:22:47.364ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81962025-01-22T05:22:47.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81972025-01-22T05:22:47.365ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81982025-01-22T05:22:47.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81992025-01-22T05:22:47.367ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82002025-01-22T05:22:47.368ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82012025-01-22T05:22:47.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82022025-01-22T05:22:47.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82032025-01-22T05:22:47.380ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update sec_id = 3fbe3917-aca1-4b36-8119-948b03a24746
82042025-01-22T05:22:47.380ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 440165b3-3c2f-49af-9600-fdc3abd0d06e saga_name = start-instance-update saga_result = SagaResult { saga_id: 440165b3-3c2f-49af-9600-fdc3abd0d06e, saga_log: SagaLog { saga_id: 440165b3-3c2f-49af-9600-fdc3abd0d06e, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("cb3541c4-0bff-43c7-8fe0-a7e0644f8a97")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("cb3541c4-0bff-43c7-8fe0-a7e0644f8a97")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("cb3541c4-0bff-43c7-8fe0-a7e0644f8a97"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("cb3541c4-0bff-43c7-8fe0-a7e0644f8a97")}} }) }
82052025-01-22T05:22:47.401ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82062025-01-22T05:22:47.401ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "73fa3fbf-a030-49ea-bea4-12d4fc69217a", "content-length": "691", "date": "Wed, 22 Jan 2025 05:22:47 GMT"} })
82072025-01-22T05:22:47.401ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
82082025-01-22T05:22:47.401ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
82092025-01-22T05:22:47.401ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
82102025-01-22T05:22:47.402ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 245.786696ms iteration = 26 status = {}
82112025-01-22T05:22:48.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e612a22f-3d47-4a68-83a9-09b47d8d4ac6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82122025-01-22T05:22:48.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e612a22f-3d47-4a68-83a9-09b47d8d4ac6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82132025-01-22T05:22:48.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e612a22f-3d47-4a68-83a9-09b47d8d4ac6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82142025-01-22T05:22:49.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50f35df9-c29a-407a-80ec-48ca34e37c73 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82152025-01-22T05:22:49.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50f35df9-c29a-407a-80ec-48ca34e37c73 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82162025-01-22T05:22:49.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 50f35df9-c29a-407a-80ec-48ca34e37c73 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82172025-01-22T05:22:49.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 4375a5ce-07c6-446a-8300-f88cea363488 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
82182025-01-22T05:22:49.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 4375a5ce-07c6-446a-8300-f88cea363488 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
82192025-01-22T05:22:49.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 4375a5ce-07c6-446a-8300-f88cea363488 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
82202025-01-22T05:22:50.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4724d4e6-d072-442c-aa99-d2fef07183fe roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82212025-01-22T05:22:50.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4724d4e6-d072-442c-aa99-d2fef07183fe resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82222025-01-22T05:22:50.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4724d4e6-d072-442c-aa99-d2fef07183fe response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82232025-01-22T05:22:51.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 68b014d5-7eef-4621-bb03-0be7b4b96dca roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82242025-01-22T05:22:51.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 68b014d5-7eef-4621-bb03-0be7b4b96dca resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82252025-01-22T05:22:51.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 68b014d5-7eef-4621-bb03-0be7b4b96dca response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82262025-01-22T05:22:52.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2c6ce9b7-651b-4335-97bd-7c437078202f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82272025-01-22T05:22:52.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2c6ce9b7-651b-4335-97bd-7c437078202f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82282025-01-22T05:22:52.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2c6ce9b7-651b-4335-97bd-7c437078202f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82292025-01-22T05:22:52.823ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
82302025-01-22T05:22:52.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82312025-01-22T05:22:52.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82322025-01-22T05:22:52.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
82332025-01-22T05:22:52.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82342025-01-22T05:22:52.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82352025-01-22T05:22:52.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82362025-01-22T05:22:52.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82372025-01-22T05:22:52.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82382025-01-22T05:22:52.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.589213ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82392025-01-22T05:22:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82402025-01-22T05:22:52.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82412025-01-22T05:22:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82422025-01-22T05:22:52.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82432025-01-22T05:22:52.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82442025-01-22T05:22:52.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82452025-01-22T05:22:52.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
82462025-01-22T05:22:52.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82472025-01-22T05:22:52.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82482025-01-22T05:22:52.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
82492025-01-22T05:22:52.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.327193ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
82502025-01-22T05:22:53.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7d600124-611c-4018-8c52-f9ff7c7e3209 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82512025-01-22T05:22:53.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7d600124-611c-4018-8c52-f9ff7c7e3209 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82522025-01-22T05:22:53.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7d600124-611c-4018-8c52-f9ff7c7e3209 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82532025-01-22T05:22:54.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c0ee3859-fb8c-4b79-9ec1-54b1e00525a6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82542025-01-22T05:22:54.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c0ee3859-fb8c-4b79-9ec1-54b1e00525a6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82552025-01-22T05:22:54.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c0ee3859-fb8c-4b79-9ec1-54b1e00525a6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82562025-01-22T05:22:55.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8a9f0f93-c4e9-49d5-bdc0-d4ce3580bd0f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82572025-01-22T05:22:55.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8a9f0f93-c4e9-49d5-bdc0-d4ce3580bd0f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82582025-01-22T05:22:55.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8a9f0f93-c4e9-49d5-bdc0-d4ce3580bd0f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82592025-01-22T05:22:55.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 654 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = ada8b121-63a0-407e-8ab5-c1c020a96790 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
82602025-01-22T05:22:56.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c1e95102-5367-4150-972e-c790af93a7cf roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82612025-01-22T05:22:56.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c1e95102-5367-4150-972e-c790af93a7cf resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82622025-01-22T05:22:56.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c1e95102-5367-4150-972e-c790af93a7cf response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82632025-01-22T05:22:57.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a369a85c-1385-4e1a-9fd1-45617f71a748 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82642025-01-22T05:22:57.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a369a85c-1385-4e1a-9fd1-45617f71a748 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82652025-01-22T05:22:57.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a369a85c-1385-4e1a-9fd1-45617f71a748 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82662025-01-22T05:22:58.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 247d0790-d02d-48b2-b08a-9c1612822271 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82672025-01-22T05:22:58.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 247d0790-d02d-48b2-b08a-9c1612822271 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82682025-01-22T05:22:58.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 247d0790-d02d-48b2-b08a-9c1612822271 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82692025-01-22T05:22:59.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a3388fd6-afe0-47e3-9d4b-fd55b1ef15e7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82702025-01-22T05:22:59.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a3388fd6-afe0-47e3-9d4b-fd55b1ef15e7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82712025-01-22T05:22:59.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a3388fd6-afe0-47e3-9d4b-fd55b1ef15e7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82722025-01-22T05:23:00.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1b85ce8b-426b-46fa-a734-35c64cb43128 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82732025-01-22T05:23:00.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1b85ce8b-426b-46fa-a734-35c64cb43128 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82742025-01-22T05:23:00.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1b85ce8b-426b-46fa-a734-35c64cb43128 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82752025-01-22T05:23:01.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 76295b24-6531-46cd-915e-1aea7651c207 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82762025-01-22T05:23:01.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 76295b24-6531-46cd-915e-1aea7651c207 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82772025-01-22T05:23:01.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 76295b24-6531-46cd-915e-1aea7651c207 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82782025-01-22T05:23:02.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a2c35c07-9e98-40fd-b4a7-e95f73598d72 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82792025-01-22T05:23:02.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a2c35c07-9e98-40fd-b4a7-e95f73598d72 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82802025-01-22T05:23:02.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a2c35c07-9e98-40fd-b4a7-e95f73598d72 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
82812025-01-22T05:23:02.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
82822025-01-22T05:23:02.824ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
82832025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82842025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82852025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
82862025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
82872025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82882025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82892025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
82902025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82912025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82922025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
82932025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
82942025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82952025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82962025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
82972025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
82982025-01-22T05:23:02.825ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82992025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
83002025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83012025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83022025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83032025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
83042025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
83052025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83062025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
83072025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83082025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
83092025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83102025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83112025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83122025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83132025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83142025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83152025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83162025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83172025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83182025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83192025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83202025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83212025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83222025-01-22T05:23:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83232025-01-22T05:23:02.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83242025-01-22T05:23:02.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83252025-01-22T05:23:02.828ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.40549ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83262025-01-22T05:23:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83272025-01-22T05:23:02.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83282025-01-22T05:23:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83292025-01-22T05:23:02.830ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83302025-01-22T05:23:02.830ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83312025-01-22T05:23:02.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83322025-01-22T05:23:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83332025-01-22T05:23:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83342025-01-22T05:23:02.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83352025-01-22T05:23:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83362025-01-22T05:23:02.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11565, tv_nsec: 178424479 } })
83372025-01-22T05:23:02.832ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
83382025-01-22T05:23:02.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83392025-01-22T05:23:02.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83402025-01-22T05:23:02.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83412025-01-22T05:23:02.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83422025-01-22T05:23:02.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11565, tv_nsec: 180847949 } })
83432025-01-22T05:23:02.834ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
83442025-01-22T05:23:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83452025-01-22T05:23:02.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83462025-01-22T05:23:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83472025-01-22T05:23:02.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83482025-01-22T05:23:02.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83492025-01-22T05:23:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83502025-01-22T05:23:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83512025-01-22T05:23:02.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83522025-01-22T05:23:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83532025-01-22T05:23:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83542025-01-22T05:23:02.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83552025-01-22T05:23:02.836ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83562025-01-22T05:23:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83572025-01-22T05:23:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
83582025-01-22T05:23:02.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83592025-01-22T05:23:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83602025-01-22T05:23:02.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83612025-01-22T05:23:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83622025-01-22T05:23:02.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83632025-01-22T05:23:02.841ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11565, tv_nsec: 188340612 } })
83642025-01-22T05:23:02.842ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
83652025-01-22T05:23:02.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83662025-01-22T05:23:02.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83672025-01-22T05:23:02.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83682025-01-22T05:23:02.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83692025-01-22T05:23:02.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83702025-01-22T05:23:02.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83712025-01-22T05:23:02.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83722025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83732025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
83742025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
83752025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83762025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83772025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
83782025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83792025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
83802025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83812025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83822025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83832025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83842025-01-22T05:23:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83852025-01-22T05:23:02.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83862025-01-22T05:23:02.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83872025-01-22T05:23:02.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83882025-01-22T05:23:02.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83892025-01-22T05:23:02.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83902025-01-22T05:23:02.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83912025-01-22T05:23:02.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83922025-01-22T05:23:02.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83932025-01-22T05:23:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83942025-01-22T05:23:02.877ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83952025-01-22T05:23:02.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83962025-01-22T05:23:02.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83972025-01-22T05:23:02.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83982025-01-22T05:23:02.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83992025-01-22T05:23:02.879ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84002025-01-22T05:23:02.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84012025-01-22T05:23:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
84022025-01-22T05:23:02.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84032025-01-22T05:23:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84042025-01-22T05:23:02.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84052025-01-22T05:23:02.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
84062025-01-22T05:23:02.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84072025-01-22T05:23:02.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84082025-01-22T05:23:02.886ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84092025-01-22T05:23:02.886ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.414021ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
84102025-01-22T05:23:02.892ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84112025-01-22T05:23:02.893ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.686319ms iteration = 26 status = 0
84122025-01-22T05:23:02.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
84132025-01-22T05:23:02.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84142025-01-22T05:23:02.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84152025-01-22T05:23:02.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.552381ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
84162025-01-22T05:23:02.899ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84172025-01-22T05:23:02.899ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84182025-01-22T05:23:02.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84192025-01-22T05:23:02.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84202025-01-22T05:23:02.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.91691ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
84212025-01-22T05:23:02.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84222025-01-22T05:23:02.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84232025-01-22T05:23:02.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.064544ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84242025-01-22T05:23:02.914ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
84252025-01-22T05:23:02.914ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.791519ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
84262025-01-22T05:23:02.915ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84272025-01-22T05:23:02.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84282025-01-22T05:23:02.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
84292025-01-22T05:23:02.931ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84302025-01-22T05:23:02.931ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f32feca-9acc-41f1-aefa-c89d7b44fc80", "content-length": "26", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
84312025-01-22T05:23:02.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84322025-01-22T05:23:02.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.386298ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84332025-01-22T05:23:02.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84342025-01-22T05:23:02.934ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84352025-01-22T05:23:02.934ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84362025-01-22T05:23:02.934ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.403488ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84372025-01-22T05:23:02.936ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
84382025-01-22T05:23:02.936ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 111.43736ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
84392025-01-22T05:23:02.940ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
84402025-01-22T05:23:02.940ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84412025-01-22T05:23:02.941ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a0eae24-3889-4c28-be5d-5907b9f90ada", "content-length": "26", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
84422025-01-22T05:23:02.941ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84432025-01-22T05:23:02.942ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84442025-01-22T05:23:02.943ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84452025-01-22T05:23:02.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84462025-01-22T05:23:02.948ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
84472025-01-22T05:23:02.948ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84482025-01-22T05:23:02.949ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce181bec-2329-4700-9ada-ae0721a6a8d6", "content-length": "26", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
84492025-01-22T05:23:02.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84502025-01-22T05:23:02.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.143751ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84512025-01-22T05:23:02.950ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
84522025-01-22T05:23:02.974ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.018528ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
84532025-01-22T05:23:02.979ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.444136ms iteration = 29 status = {"physical_disks_added":0}
84542025-01-22T05:23:03.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84552025-01-22T05:23:03.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84562025-01-22T05:23:03.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84572025-01-22T05:23:03.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84582025-01-22T05:23:03.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84592025-01-22T05:23:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84602025-01-22T05:23:03.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84612025-01-22T05:23:03.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84622025-01-22T05:23:03.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84632025-01-22T05:23:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84642025-01-22T05:23:03.040ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84652025-01-22T05:23:03.040ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84662025-01-22T05:23:03.040ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad1e9c89-c428-49b5-bb3b-7785c7422b25", "content-length": "372", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
84672025-01-22T05:23:03.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84682025-01-22T05:23:03.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84692025-01-22T05:23:03.040ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84702025-01-22T05:23:03.041ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5710c521-8875-4144-b6ab-2d95db1c756e", "content-length": "2", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
84712025-01-22T05:23:03.042ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84722025-01-22T05:23:03.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84732025-01-22T05:23:03.044ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.481921ms iteration = 26 status = null
84742025-01-22T05:23:03.049ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 224.879921ms iteration = 26 status = {}
84752025-01-22T05:23:03.055ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
84762025-01-22T05:23:03.055ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84772025-01-22T05:23:03.055ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "08f6c587-2295-4c9f-8714-300000ac774c", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
84782025-01-22T05:23:03.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84792025-01-22T05:23:03.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84802025-01-22T05:23:03.106ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84812025-01-22T05:23:03.106ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdd249b4-c747-448e-8d1f-f23e7f845cb8", "content-length": "691", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
84822025-01-22T05:23:03.106ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84832025-01-22T05:23:03.106ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84842025-01-22T05:23:03.107ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84852025-01-22T05:23:03.107ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 282.675878ms iteration = 27 status = {}
84862025-01-22T05:23:03.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84872025-01-22T05:23:03.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84882025-01-22T05:23:03.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84892025-01-22T05:23:03.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84902025-01-22T05:23:03.115ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
84912025-01-22T05:23:03.115ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84922025-01-22T05:23:03.115ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e3beee71-c186-4ced-ad3f-b4038e0323af", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
84932025-01-22T05:23:03.116ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.885876ms iteration = 27 status = {}
84942025-01-22T05:23:03.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84952025-01-22T05:23:03.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84962025-01-22T05:23:03.145ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
84972025-01-22T05:23:03.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84982025-01-22T05:23:03.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84992025-01-22T05:23:03.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85002025-01-22T05:23:03.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e69a7985-0d8e-498a-ab70-a63c7db8bb67", "content-length": "134", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
85012025-01-22T05:23:03.154ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85022025-01-22T05:23:03.154ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
85032025-01-22T05:23:03.154ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85042025-01-22T05:23:03.154ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85052025-01-22T05:23:03.154ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85062025-01-22T05:23:03.154ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85072025-01-22T05:23:03.154ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85082025-01-22T05:23:03.154ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85092025-01-22T05:23:03.155ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85102025-01-22T05:23:03.155ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85112025-01-22T05:23:03.155ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
85122025-01-22T05:23:03.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85132025-01-22T05:23:03.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85142025-01-22T05:23:03.157ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85152025-01-22T05:23:03.157ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7be985e-628a-47e7-8f0a-619598f76619", "content-length": "2", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
85162025-01-22T05:23:03.157ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85172025-01-22T05:23:03.157ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "667f4a2f-c06a-46bb-a018-5f963889a4d6", "content-length": "51", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
85182025-01-22T05:23:03.157ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
85192025-01-22T05:23:03.157ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85202025-01-22T05:23:03.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bea1a8b0-537f-4449-8272-6a517a153f13", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
85212025-01-22T05:23:03.248ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
85222025-01-22T05:23:03.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85232025-01-22T05:23:03.248ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0cfb924-292c-48ce-9109-7425fb245fb6", "content-length": "682", "date": "Wed, 22 Jan 2025 05:23:02 GMT"} })
85242025-01-22T05:23:03.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85252025-01-22T05:23:03.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85262025-01-22T05:23:03.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85272025-01-22T05:23:03.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85282025-01-22T05:23:03.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85292025-01-22T05:23:03.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85302025-01-22T05:23:03.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85312025-01-22T05:23:03.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85322025-01-22T05:23:03.265ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 440.34825ms iteration = 26 status = {}
85332025-01-22T05:23:03.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = abc65af4-ec5b-472e-8e3b-6612b3f42b27 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85342025-01-22T05:23:03.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = abc65af4-ec5b-472e-8e3b-6612b3f42b27 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85352025-01-22T05:23:03.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = abc65af4-ec5b-472e-8e3b-6612b3f42b27 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85362025-01-22T05:23:04.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 66945fdd-3768-46b3-bc24-f0769015cdff roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85372025-01-22T05:23:04.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 66945fdd-3768-46b3-bc24-f0769015cdff resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85382025-01-22T05:23:04.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 66945fdd-3768-46b3-bc24-f0769015cdff response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85392025-01-22T05:23:05.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a3303b78-f483-4adf-bfe9-83c78657dd1f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85402025-01-22T05:23:05.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a3303b78-f483-4adf-bfe9-83c78657dd1f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85412025-01-22T05:23:05.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a3303b78-f483-4adf-bfe9-83c78657dd1f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85422025-01-22T05:23:05.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 595 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 779d15dd-7e2e-4985-a73e-a3f3d4256fa0 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
85432025-01-22T05:23:06.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0544f82e-90b1-4817-93ed-5d46ff8f34d3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85442025-01-22T05:23:06.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0544f82e-90b1-4817-93ed-5d46ff8f34d3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85452025-01-22T05:23:06.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0544f82e-90b1-4817-93ed-5d46ff8f34d3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85462025-01-22T05:23:07.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 740a67e4-f99d-4215-825d-d65a4ef45cfb roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85472025-01-22T05:23:07.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 740a67e4-f99d-4215-825d-d65a4ef45cfb resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85482025-01-22T05:23:07.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 740a67e4-f99d-4215-825d-d65a4ef45cfb response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85492025-01-22T05:23:08.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 13242e24-3d4c-4662-8bf3-960fcc9d40dd roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85502025-01-22T05:23:08.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 13242e24-3d4c-4662-8bf3-960fcc9d40dd resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85512025-01-22T05:23:08.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 13242e24-3d4c-4662-8bf3-960fcc9d40dd response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85522025-01-22T05:23:09.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 175abe52-6063-4569-81b1-0c6c6d49086b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85532025-01-22T05:23:09.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 175abe52-6063-4569-81b1-0c6c6d49086b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85542025-01-22T05:23:09.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 175abe52-6063-4569-81b1-0c6c6d49086b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85552025-01-22T05:23:10.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ae659404-fcc8-4262-8d90-1b440b893dcf roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85562025-01-22T05:23:10.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ae659404-fcc8-4262-8d90-1b440b893dcf resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85572025-01-22T05:23:10.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ae659404-fcc8-4262-8d90-1b440b893dcf response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85582025-01-22T05:23:11.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b3c354ee-ffd5-4547-9c7f-9c2f474515b2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85592025-01-22T05:23:11.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b3c354ee-ffd5-4547-9c7f-9c2f474515b2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85602025-01-22T05:23:11.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b3c354ee-ffd5-4547-9c7f-9c2f474515b2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85612025-01-22T05:23:12.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5b39d270-5369-48e4-aa7a-2a598b54fc18 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85622025-01-22T05:23:12.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5b39d270-5369-48e4-aa7a-2a598b54fc18 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85632025-01-22T05:23:12.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5b39d270-5369-48e4-aa7a-2a598b54fc18 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85642025-01-22T05:23:12.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
85652025-01-22T05:23:12.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85662025-01-22T05:23:12.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85672025-01-22T05:23:12.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
85682025-01-22T05:23:12.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85692025-01-22T05:23:12.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85702025-01-22T05:23:12.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85712025-01-22T05:23:12.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85722025-01-22T05:23:12.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85732025-01-22T05:23:12.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85742025-01-22T05:23:12.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85752025-01-22T05:23:12.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85762025-01-22T05:23:12.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85772025-01-22T05:23:12.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
85782025-01-22T05:23:12.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85792025-01-22T05:23:12.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85802025-01-22T05:23:12.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
85812025-01-22T05:23:12.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.505368ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
85822025-01-22T05:23:12.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85832025-01-22T05:23:12.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85842025-01-22T05:23:12.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.974851ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85852025-01-22T05:23:13.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 70fad81f-efd5-4885-9674-2b1668dafb14 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85862025-01-22T05:23:13.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 70fad81f-efd5-4885-9674-2b1668dafb14 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85872025-01-22T05:23:13.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 70fad81f-efd5-4885-9674-2b1668dafb14 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85882025-01-22T05:23:14.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f8cd26ac-89eb-4286-8d6b-50373a9f34e1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85892025-01-22T05:23:14.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f8cd26ac-89eb-4286-8d6b-50373a9f34e1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85902025-01-22T05:23:14.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f8cd26ac-89eb-4286-8d6b-50373a9f34e1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85912025-01-22T05:23:15.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ee4a85d8-d253-43d4-9fe6-0d33873710ff roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85922025-01-22T05:23:15.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ee4a85d8-d253-43d4-9fe6-0d33873710ff resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85932025-01-22T05:23:15.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ee4a85d8-d253-43d4-9fe6-0d33873710ff response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85942025-01-22T05:23:15.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 599cb10a-4f6d-48ce-b04d-fb7453a1eb4b response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
85952025-01-22T05:23:16.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 981d7153-ddef-468a-ad0f-0f4c224c580d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85962025-01-22T05:23:16.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 981d7153-ddef-468a-ad0f-0f4c224c580d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85972025-01-22T05:23:16.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 981d7153-ddef-468a-ad0f-0f4c224c580d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85982025-01-22T05:23:17.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f6cd16f-efb3-46ad-b8ba-725178f292fe roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
85992025-01-22T05:23:17.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f6cd16f-efb3-46ad-b8ba-725178f292fe resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86002025-01-22T05:23:17.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6f6cd16f-efb3-46ad-b8ba-725178f292fe response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86012025-01-22T05:23:18.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4da47e0d-9e09-4632-bd8a-0d8f2118c4c4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86022025-01-22T05:23:18.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4da47e0d-9e09-4632-bd8a-0d8f2118c4c4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86032025-01-22T05:23:18.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4da47e0d-9e09-4632-bd8a-0d8f2118c4c4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86042025-01-22T05:23:19.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 77e7fefc-8335-45e0-aa33-f5b581161b13 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
86052025-01-22T05:23:19.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 77e7fefc-8335-45e0-aa33-f5b581161b13 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
86062025-01-22T05:23:19.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 77e7fefc-8335-45e0-aa33-f5b581161b13 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
86072025-01-22T05:23:19.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dc754154-d3c3-49be-8a3b-a7f1785f71da roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86082025-01-22T05:23:19.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dc754154-d3c3-49be-8a3b-a7f1785f71da resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86092025-01-22T05:23:19.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dc754154-d3c3-49be-8a3b-a7f1785f71da response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86102025-01-22T05:23:20.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ee98bd70-1715-4721-9494-802de3a1f962 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86112025-01-22T05:23:20.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ee98bd70-1715-4721-9494-802de3a1f962 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86122025-01-22T05:23:20.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ee98bd70-1715-4721-9494-802de3a1f962 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86132025-01-22T05:23:21.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3fe024ce-5efe-44d2-934b-2a973b3ad0f0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86142025-01-22T05:23:21.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3fe024ce-5efe-44d2-934b-2a973b3ad0f0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86152025-01-22T05:23:21.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3fe024ce-5efe-44d2-934b-2a973b3ad0f0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86162025-01-22T05:23:22.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 497d9732-4ccb-4565-a1fc-f73a9f84375c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86172025-01-22T05:23:22.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 497d9732-4ccb-4565-a1fc-f73a9f84375c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86182025-01-22T05:23:22.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 497d9732-4ccb-4565-a1fc-f73a9f84375c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86192025-01-22T05:23:22.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
86202025-01-22T05:23:22.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86212025-01-22T05:23:22.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86222025-01-22T05:23:22.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
86232025-01-22T05:23:22.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86242025-01-22T05:23:22.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86252025-01-22T05:23:22.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86262025-01-22T05:23:22.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86272025-01-22T05:23:22.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86282025-01-22T05:23:22.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86292025-01-22T05:23:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86302025-01-22T05:23:22.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86312025-01-22T05:23:22.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86322025-01-22T05:23:22.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86332025-01-22T05:23:22.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86342025-01-22T05:23:22.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
86352025-01-22T05:23:22.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86362025-01-22T05:23:22.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86372025-01-22T05:23:22.847ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
86382025-01-22T05:23:22.847ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.711033ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
86392025-01-22T05:23:22.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.360029ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86402025-01-22T05:23:23.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c7b26f02-eba5-4018-924c-61c8ca228c2a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86412025-01-22T05:23:23.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c7b26f02-eba5-4018-924c-61c8ca228c2a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86422025-01-22T05:23:23.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c7b26f02-eba5-4018-924c-61c8ca228c2a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86432025-01-22T05:23:24.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1a72b4dd-1096-482c-9d38-ea62fa41d055 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86442025-01-22T05:23:24.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1a72b4dd-1096-482c-9d38-ea62fa41d055 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86452025-01-22T05:23:24.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1a72b4dd-1096-482c-9d38-ea62fa41d055 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86462025-01-22T05:23:25.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 035a97ab-f319-49d6-865e-3cd72b7f3eac roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86472025-01-22T05:23:25.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 035a97ab-f319-49d6-865e-3cd72b7f3eac resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86482025-01-22T05:23:25.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 035a97ab-f319-49d6-865e-3cd72b7f3eac response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86492025-01-22T05:23:25.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 914 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 139c18c7-a9f5-43bf-b10e-97a0d4c5de45 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
86502025-01-22T05:23:26.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72cb4ee1-c7bd-4eaa-b98a-6c92f24c2b9c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86512025-01-22T05:23:26.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72cb4ee1-c7bd-4eaa-b98a-6c92f24c2b9c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86522025-01-22T05:23:26.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 72cb4ee1-c7bd-4eaa-b98a-6c92f24c2b9c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86532025-01-22T05:23:27.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 38d1e33b-b964-4e72-9b2f-3e8682752bf8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86542025-01-22T05:23:27.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 38d1e33b-b964-4e72-9b2f-3e8682752bf8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86552025-01-22T05:23:27.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 38d1e33b-b964-4e72-9b2f-3e8682752bf8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86562025-01-22T05:23:28.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8ef64344-8a24-4ff7-9f79-9de09ca15c23 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86572025-01-22T05:23:28.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8ef64344-8a24-4ff7-9f79-9de09ca15c23 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86582025-01-22T05:23:28.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8ef64344-8a24-4ff7-9f79-9de09ca15c23 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86592025-01-22T05:23:29.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aaba87ea-9ba7-4a23-8742-9d26b23ccb61 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86602025-01-22T05:23:29.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aaba87ea-9ba7-4a23-8742-9d26b23ccb61 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86612025-01-22T05:23:29.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aaba87ea-9ba7-4a23-8742-9d26b23ccb61 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86622025-01-22T05:23:30.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 67ed5161-a05b-4d5f-92f9-59e85bd0dba1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86632025-01-22T05:23:30.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 67ed5161-a05b-4d5f-92f9-59e85bd0dba1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86642025-01-22T05:23:30.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 67ed5161-a05b-4d5f-92f9-59e85bd0dba1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86652025-01-22T05:23:31.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 934adbf8-5a51-4f45-958b-5e1e6c84aa22 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86662025-01-22T05:23:31.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 934adbf8-5a51-4f45-958b-5e1e6c84aa22 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86672025-01-22T05:23:31.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 934adbf8-5a51-4f45-958b-5e1e6c84aa22 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
86682025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
86692025-01-22T05:23:32.824ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
86702025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
86712025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
86722025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86732025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86742025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
86752025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
86762025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
86772025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
86782025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86792025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86802025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
86812025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86822025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
86832025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
86842025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
86852025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86862025-01-22T05:23:32.824ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:13:32.824391499 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
86872025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
86882025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
86892025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86902025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
86912025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86922025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
86932025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
86942025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
86952025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86962025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86972025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86982025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
86992025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87002025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
87012025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87022025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87032025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
87042025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
87052025-01-22T05:23:32.824ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
87062025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
87072025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.051\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
87082025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87092025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87102025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87112025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
87122025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87132025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87142025-01-22T05:23:32.824ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11595, tv_nsec: 171288994 } })
87152025-01-22T05:23:32.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87162025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87172025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87182025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87192025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87202025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87212025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87222025-01-22T05:23:32.825ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11595, tv_nsec: 171411517 } })
87232025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87242025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
87252025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
87262025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87272025-01-22T05:23:32.825ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87282025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87292025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
87302025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87312025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
87322025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
87332025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87342025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87352025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
87362025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87372025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87382025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
87392025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.084211ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
87402025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87412025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87422025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87432025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87442025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87452025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
87462025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
87472025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.113393ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
87482025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87492025-01-22T05:23:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87502025-01-22T05:23:32.827ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87512025-01-22T05:23:32.827ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.313318ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87522025-01-22T05:23:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87532025-01-22T05:23:32.829ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87542025-01-22T05:23:32.829ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:13:32.824391499 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
87552025-01-22T05:23:32.829ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.91924ms iteration = 14 status = {"expiration":"2025-01-22T05:13:32.824391499Z","pruned":[]}
87562025-01-22T05:23:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87572025-01-22T05:23:32.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87582025-01-22T05:23:32.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87592025-01-22T05:23:32.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87602025-01-22T05:23:32.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11595, tv_nsec: 176674314 } })
87612025-01-22T05:23:32.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
87622025-01-22T05:23:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87632025-01-22T05:23:32.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87642025-01-22T05:23:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87652025-01-22T05:23:32.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87662025-01-22T05:23:32.831ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87672025-01-22T05:23:32.832ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87682025-01-22T05:23:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87692025-01-22T05:23:32.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87702025-01-22T05:23:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
87712025-01-22T05:23:32.834ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87722025-01-22T05:23:32.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87732025-01-22T05:23:32.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87742025-01-22T05:23:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87752025-01-22T05:23:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87762025-01-22T05:23:32.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87772025-01-22T05:23:32.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11595, tv_nsec: 182892571 } })
87782025-01-22T05:23:32.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87792025-01-22T05:23:32.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87802025-01-22T05:23:32.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
87812025-01-22T05:23:32.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87822025-01-22T05:23:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87832025-01-22T05:23:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87842025-01-22T05:23:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87852025-01-22T05:23:32.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87862025-01-22T05:23:32.839ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87872025-01-22T05:23:32.839ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87882025-01-22T05:23:32.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87892025-01-22T05:23:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87902025-01-22T05:23:32.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87912025-01-22T05:23:32.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87922025-01-22T05:23:32.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87932025-01-22T05:23:32.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87942025-01-22T05:23:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87952025-01-22T05:23:32.844ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11595, tv_nsec: 190799222 } })
87962025-01-22T05:23:32.844ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
87972025-01-22T05:23:32.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87982025-01-22T05:23:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87992025-01-22T05:23:32.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.359745ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88002025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
88012025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
88022025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88032025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
88042025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
88052025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88062025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
88072025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88082025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
88092025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88102025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88112025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88122025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88132025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88142025-01-22T05:23:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88152025-01-22T05:23:32.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88162025-01-22T05:23:32.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.154054ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
88172025-01-22T05:23:32.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88182025-01-22T05:23:32.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88192025-01-22T05:23:32.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88202025-01-22T05:23:32.854ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.922821ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
88212025-01-22T05:23:32.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88222025-01-22T05:23:32.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88232025-01-22T05:23:32.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.915242ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
88242025-01-22T05:23:32.856ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88252025-01-22T05:23:32.856ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 31.063053ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88262025-01-22T05:23:32.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88272025-01-22T05:23:32.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88282025-01-22T05:23:32.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88292025-01-22T05:23:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88302025-01-22T05:23:32.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88312025-01-22T05:23:32.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88322025-01-22T05:23:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88332025-01-22T05:23:32.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88342025-01-22T05:23:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88352025-01-22T05:23:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88362025-01-22T05:23:32.892ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88372025-01-22T05:23:32.892ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88382025-01-22T05:23:32.892ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.817361ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88392025-01-22T05:23:32.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88402025-01-22T05:23:32.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88412025-01-22T05:23:32.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88422025-01-22T05:23:32.896ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
88432025-01-22T05:23:32.896ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
88442025-01-22T05:23:32.896ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.999166ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
88452025-01-22T05:23:32.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88462025-01-22T05:23:32.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88472025-01-22T05:23:32.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88482025-01-22T05:23:32.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88492025-01-22T05:23:32.898ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88502025-01-22T05:23:32.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88512025-01-22T05:23:32.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88522025-01-22T05:23:32.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88532025-01-22T05:23:32.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88542025-01-22T05:23:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88552025-01-22T05:23:32.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88562025-01-22T05:23:32.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88572025-01-22T05:23:32.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88582025-01-22T05:23:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88592025-01-22T05:23:32.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88602025-01-22T05:23:32.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.129745ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88612025-01-22T05:23:32.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88622025-01-22T05:23:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88632025-01-22T05:23:32.913ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88642025-01-22T05:23:32.913ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88652025-01-22T05:23:32.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88662025-01-22T05:23:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88672025-01-22T05:23:32.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88682025-01-22T05:23:32.915ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88692025-01-22T05:23:32.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88702025-01-22T05:23:32.916ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88712025-01-22T05:23:32.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88722025-01-22T05:23:32.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
88732025-01-22T05:23:32.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88742025-01-22T05:23:32.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88752025-01-22T05:23:32.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88762025-01-22T05:23:32.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88772025-01-22T05:23:32.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 79.775185ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
88782025-01-22T05:23:32.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88792025-01-22T05:23:32.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88802025-01-22T05:23:32.939ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88812025-01-22T05:23:32.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88822025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
88832025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88842025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
88852025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
88862025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88872025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88882025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88892025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88902025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88912025-01-22T05:23:32.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88922025-01-22T05:23:32.963ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88932025-01-22T05:23:32.963ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88942025-01-22T05:23:32.963ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.565173ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88952025-01-22T05:23:32.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e0dcfd9b-285d-48c9-b97b-609c70a7c3dc roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
88962025-01-22T05:23:32.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e0dcfd9b-285d-48c9-b97b-609c70a7c3dc resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
88972025-01-22T05:23:32.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88982025-01-22T05:23:32.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88992025-01-22T05:23:32.998ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89002025-01-22T05:23:33.010ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
89012025-01-22T05:23:33.010ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89022025-01-22T05:23:33.010ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e23dcbe0-a12a-4345-b319-4074024a8e2b", "content-length": "26", "date": "Wed, 22 Jan 2025 05:23:33 GMT"} })
89032025-01-22T05:23:33.010ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89042025-01-22T05:23:33.013ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89052025-01-22T05:23:33.020ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
89062025-01-22T05:23:33.021ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 196.983362ms iteration = 30 status = {"physical_disks_added":0}
89072025-01-22T05:23:33.142ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
89082025-01-22T05:23:33.142ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89092025-01-22T05:23:33.143ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0286d6a-dc44-4ede-9ad4-3d0aecb277cd", "content-length": "26", "date": "Wed, 22 Jan 2025 05:23:33 GMT"} })
89102025-01-22T05:23:33.143ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89112025-01-22T05:23:33.144ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
89122025-01-22T05:23:33.144ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89132025-01-22T05:23:33.144ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
89142025-01-22T05:23:33.144ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "170930ac-b98d-4dfc-8cb4-498e0a882526", "content-length": "26", "date": "Wed, 22 Jan 2025 05:23:33 GMT"} })
89152025-01-22T05:23:33.144ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89162025-01-22T05:23:33.146ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89172025-01-22T05:23:33.157ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89182025-01-22T05:23:33.158ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fb15aec6-15c1-47ac-8a53-7284d8c361a0", "date": "Wed, 22 Jan 2025 05:23:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89192025-01-22T05:23:33.158ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89202025-01-22T05:23:33.159ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ab0cc09e-134d-413b-b006-a2d4662205a3", "date": "Wed, 22 Jan 2025 05:23:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89212025-01-22T05:23:33.159ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89222025-01-22T05:23:33.161ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89232025-01-22T05:23:33.161ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 336.843262ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
89242025-01-22T05:23:33.198ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.466978ms iteration = 27 status = {}
89252025-01-22T05:23:33.228ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89262025-01-22T05:23:33.228ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89272025-01-22T05:23:33.228ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d22103f-ebde-4925-a5a9-cdd7ac17c0f8", "content-length": "372", "date": "Wed, 22 Jan 2025 05:23:32 GMT"} })
89282025-01-22T05:23:33.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89292025-01-22T05:23:33.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89302025-01-22T05:23:33.230ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89312025-01-22T05:23:33.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 383.964832ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89322025-01-22T05:23:33.231ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89332025-01-22T05:23:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
89342025-01-22T05:23:33.232ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89352025-01-22T05:23:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89362025-01-22T05:23:33.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89372025-01-22T05:23:33.233ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89382025-01-22T05:23:33.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89392025-01-22T05:23:33.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89402025-01-22T05:23:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89412025-01-22T05:23:33.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89422025-01-22T05:23:33.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89432025-01-22T05:23:33.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e0dcfd9b-285d-48c9-b97b-609c70a7c3dc response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
89442025-01-22T05:23:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89452025-01-22T05:23:33.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89462025-01-22T05:23:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89472025-01-22T05:23:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89482025-01-22T05:23:33.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89492025-01-22T05:23:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89502025-01-22T05:23:33.241ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
89512025-01-22T05:23:33.241ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 417.198698ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
89522025-01-22T05:23:33.264ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
89532025-01-22T05:23:33.266ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89542025-01-22T05:23:33.267ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6abbcee-c32e-45b9-90e9-a9bfad6614ca", "content-length": "2", "date": "Wed, 22 Jan 2025 05:23:33 GMT"} })
89552025-01-22T05:23:33.268ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89562025-01-22T05:23:33.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89572025-01-22T05:23:33.271ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 446.72611ms iteration = 27 status = null
89582025-01-22T05:23:33.278ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
89592025-01-22T05:23:33.278ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 454.179702ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
89602025-01-22T05:23:33.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89612025-01-22T05:23:33.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89622025-01-22T05:23:33.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89632025-01-22T05:23:33.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89642025-01-22T05:23:33.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89652025-01-22T05:23:33.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89662025-01-22T05:23:33.283ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
89672025-01-22T05:23:33.283ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
89682025-01-22T05:23:33.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89692025-01-22T05:23:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89702025-01-22T05:23:33.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89712025-01-22T05:23:33.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89722025-01-22T05:23:33.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89732025-01-22T05:23:33.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
89742025-01-22T05:23:33.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89752025-01-22T05:23:33.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89762025-01-22T05:23:33.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89772025-01-22T05:23:33.286ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
89782025-01-22T05:23:33.286ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 462.055912ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
89792025-01-22T05:23:33.287ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 462.556423ms iteration = 27 status = 0
89802025-01-22T05:23:33.288ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89812025-01-22T05:23:33.288ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89822025-01-22T05:23:33.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89832025-01-22T05:23:33.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89842025-01-22T05:23:33.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89852025-01-22T05:23:33.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89862025-01-22T05:23:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89872025-01-22T05:23:33.290ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
89882025-01-22T05:23:33.290ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
89892025-01-22T05:23:33.291ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
89902025-01-22T05:23:33.291ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 466.720847ms iteration = 14 status = {"generation":2}
89912025-01-22T05:23:33.293ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
89922025-01-22T05:23:33.293ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89932025-01-22T05:23:33.293ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4dcde812-134f-48d1-a620-03c5a3f23321", "date": "Wed, 22 Jan 2025 05:23:32 GMT"} })
89942025-01-22T05:23:33.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89952025-01-22T05:23:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89962025-01-22T05:23:33.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89972025-01-22T05:23:33.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89982025-01-22T05:23:33.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89992025-01-22T05:23:33.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90002025-01-22T05:23:33.304ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90012025-01-22T05:23:33.304ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90022025-01-22T05:23:33.305ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "83ec1405-85a7-4ddf-a60d-16392e5530fa", "date": "Wed, 22 Jan 2025 05:23:32 GMT"} })
90032025-01-22T05:23:33.307ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 481.863386ms iteration = 28 status = {}
90042025-01-22T05:23:33.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90052025-01-22T05:23:33.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90062025-01-22T05:23:33.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90072025-01-22T05:23:33.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90082025-01-22T05:23:33.325ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90092025-01-22T05:23:33.325ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90102025-01-22T05:23:33.325ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
90112025-01-22T05:23:33.325ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 501.224831ms iteration = 14 status = {"generation":1}
90122025-01-22T05:23:33.332ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
90132025-01-22T05:23:33.332ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 507.450937ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
90142025-01-22T05:23:33.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
90152025-01-22T05:23:33.333ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "84ead80b-b797-405b-a01c-bd330be73805", "date": "Wed, 22 Jan 2025 05:23:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90162025-01-22T05:23:33.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90172025-01-22T05:23:33.335ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "078e96a1-c88b-4853-92a7-3f307267553f", "date": "Wed, 22 Jan 2025 05:23:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90182025-01-22T05:23:33.335ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90192025-01-22T05:23:33.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9fc9bc70-3a2e-4296-a7ce-8af42e2bc9c0", "date": "Wed, 22 Jan 2025 05:23:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90202025-01-22T05:23:33.337ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90212025-01-22T05:23:33.339ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90222025-01-22T05:23:33.339ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 515.520162ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
90232025-01-22T05:23:33.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90242025-01-22T05:23:33.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90252025-01-22T05:23:33.397ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90262025-01-22T05:23:33.397ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4d41cc8-41e3-45d7-8d53-dc1a486a3c87", "content-length": "691", "date": "Wed, 22 Jan 2025 05:23:32 GMT"} })
90272025-01-22T05:23:33.397ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90282025-01-22T05:23:33.397ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90292025-01-22T05:23:33.397ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90302025-01-22T05:23:33.399ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 574.81761ms iteration = 28 status = {}
90312025-01-22T05:23:33.399ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
90322025-01-22T05:23:33.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90332025-01-22T05:23:33.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90342025-01-22T05:23:33.408ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90352025-01-22T05:23:33.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dec28d2-515e-48dd-8769-0819e7b94c1a", "content-length": "134", "date": "Wed, 22 Jan 2025 05:23:33 GMT"} })
90362025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90372025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
90382025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90392025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90402025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90412025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90422025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90432025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90442025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90452025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90462025-01-22T05:23:33.409ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
90472025-01-22T05:23:33.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90482025-01-22T05:23:33.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90492025-01-22T05:23:33.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90502025-01-22T05:23:33.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e8175f0-8393-4907-8321-605c73e5482a", "content-length": "2", "date": "Wed, 22 Jan 2025 05:23:33 GMT"} })
90512025-01-22T05:23:33.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90522025-01-22T05:23:33.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eef0a591-50d3-48c3-ac5d-5a3f00e65beb", "content-length": "51", "date": "Wed, 22 Jan 2025 05:23:33 GMT"} })
90532025-01-22T05:23:33.412ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
90542025-01-22T05:23:33.412ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90552025-01-22T05:23:33.504ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "31fc7657-20d9-4a84-9587-a7172e4acbe0", "date": "Wed, 22 Jan 2025 05:23:32 GMT"} })
90562025-01-22T05:23:33.504ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
90572025-01-22T05:23:33.504ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90582025-01-22T05:23:33.504ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "06f2fe20-cd35-463e-b81b-768ab935c338", "content-length": "682", "date": "Wed, 22 Jan 2025 05:23:32 GMT"} })
90592025-01-22T05:23:33.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90602025-01-22T05:23:33.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90612025-01-22T05:23:33.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90622025-01-22T05:23:33.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90632025-01-22T05:23:33.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90642025-01-22T05:23:33.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90652025-01-22T05:23:33.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90662025-01-22T05:23:33.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90672025-01-22T05:23:33.521ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 696.663251ms iteration = 27 status = {}
90682025-01-22T05:23:34.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 783e98bb-99b6-4532-b367-d7d6ad1b4661 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90692025-01-22T05:23:34.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 783e98bb-99b6-4532-b367-d7d6ad1b4661 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90702025-01-22T05:23:34.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 783e98bb-99b6-4532-b367-d7d6ad1b4661 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90712025-01-22T05:23:35.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ac9d7eec-dd0c-4257-93b0-116982643d18 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90722025-01-22T05:23:35.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ac9d7eec-dd0c-4257-93b0-116982643d18 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90732025-01-22T05:23:35.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ac9d7eec-dd0c-4257-93b0-116982643d18 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90742025-01-22T05:23:35.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 967 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 3fe4e770-b093-4069-a627-58a66f269481 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
90752025-01-22T05:23:36.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7e766d54-4d62-4281-8604-91dc32cea1ac roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90762025-01-22T05:23:36.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7e766d54-4d62-4281-8604-91dc32cea1ac resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90772025-01-22T05:23:36.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7e766d54-4d62-4281-8604-91dc32cea1ac response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90782025-01-22T05:23:37.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f1ba46a-2614-4df1-95a2-85be8f43a94c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90792025-01-22T05:23:37.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f1ba46a-2614-4df1-95a2-85be8f43a94c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90802025-01-22T05:23:37.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5f1ba46a-2614-4df1-95a2-85be8f43a94c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90812025-01-22T05:23:38.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 36c95663-e8b1-44d4-8dc3-5fdd665113fa roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90822025-01-22T05:23:38.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 36c95663-e8b1-44d4-8dc3-5fdd665113fa resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90832025-01-22T05:23:38.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 36c95663-e8b1-44d4-8dc3-5fdd665113fa response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90842025-01-22T05:23:39.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fa66c7df-a8ab-484e-80f0-244804e79bd6 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90852025-01-22T05:23:39.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fa66c7df-a8ab-484e-80f0-244804e79bd6 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90862025-01-22T05:23:39.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fa66c7df-a8ab-484e-80f0-244804e79bd6 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90872025-01-22T05:23:40.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 863bd07d-3edc-4308-aebb-af738655f5c5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90882025-01-22T05:23:40.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 863bd07d-3edc-4308-aebb-af738655f5c5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90892025-01-22T05:23:40.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 863bd07d-3edc-4308-aebb-af738655f5c5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90902025-01-22T05:23:41.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aff09053-f06e-47f9-983d-851d73374927 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90912025-01-22T05:23:41.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aff09053-f06e-47f9-983d-851d73374927 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90922025-01-22T05:23:41.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = aff09053-f06e-47f9-983d-851d73374927 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90932025-01-22T05:23:42.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 19861987-1661-491e-8a3d-f9f86c718cdd roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90942025-01-22T05:23:42.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 19861987-1661-491e-8a3d-f9f86c718cdd resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90952025-01-22T05:23:42.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 19861987-1661-491e-8a3d-f9f86c718cdd response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
90962025-01-22T05:23:42.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
90972025-01-22T05:23:42.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90982025-01-22T05:23:42.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90992025-01-22T05:23:42.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
91002025-01-22T05:23:42.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91012025-01-22T05:23:42.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91022025-01-22T05:23:42.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91032025-01-22T05:23:42.827ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91042025-01-22T05:23:42.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91052025-01-22T05:23:42.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91062025-01-22T05:23:42.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91072025-01-22T05:23:42.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91082025-01-22T05:23:42.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.896099ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91092025-01-22T05:23:42.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91102025-01-22T05:23:42.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91112025-01-22T05:23:42.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91122025-01-22T05:23:42.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
91132025-01-22T05:23:42.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91142025-01-22T05:23:42.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91152025-01-22T05:23:42.846ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
91162025-01-22T05:23:42.846ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.014188ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
91172025-01-22T05:23:43.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a28cee34-72eb-4b41-ac65-8c1a4ac4d45b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91182025-01-22T05:23:43.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a28cee34-72eb-4b41-ac65-8c1a4ac4d45b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91192025-01-22T05:23:43.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a28cee34-72eb-4b41-ac65-8c1a4ac4d45b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91202025-01-22T05:23:44.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 63f794ab-bec6-4043-9cfd-0b669d5c1261 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91212025-01-22T05:23:44.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 63f794ab-bec6-4043-9cfd-0b669d5c1261 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91222025-01-22T05:23:44.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 63f794ab-bec6-4043-9cfd-0b669d5c1261 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91232025-01-22T05:23:45.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a81e683-8c34-46d2-a625-bd10e20596cc roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91242025-01-22T05:23:45.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a81e683-8c34-46d2-a625-bd10e20596cc resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91252025-01-22T05:23:45.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a81e683-8c34-46d2-a625-bd10e20596cc response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91262025-01-22T05:23:45.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 585 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 4ce2eaed-dd1e-481f-aa6a-e0064a35462a response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
91272025-01-22T05:23:46.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 75448dd7-69cb-4e8a-ba1a-6ab1f18ee6b3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91282025-01-22T05:23:46.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 75448dd7-69cb-4e8a-ba1a-6ab1f18ee6b3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91292025-01-22T05:23:46.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 75448dd7-69cb-4e8a-ba1a-6ab1f18ee6b3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91302025-01-22T05:23:47.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a7088d9f-d859-4115-bc3f-d2227cffeb91 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91312025-01-22T05:23:47.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a7088d9f-d859-4115-bc3f-d2227cffeb91 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91322025-01-22T05:23:47.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a7088d9f-d859-4115-bc3f-d2227cffeb91 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91332025-01-22T05:23:48.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 84ce9aad-2f05-4938-9215-2f1c04e64133 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91342025-01-22T05:23:48.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 84ce9aad-2f05-4938-9215-2f1c04e64133 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91352025-01-22T05:23:48.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 84ce9aad-2f05-4938-9215-2f1c04e64133 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91362025-01-22T05:23:49.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = ee28ada9-4950-4e21-8efd-2dfb77916176 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
91372025-01-22T05:23:49.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = ee28ada9-4950-4e21-8efd-2dfb77916176 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
91382025-01-22T05:23:49.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = ee28ada9-4950-4e21-8efd-2dfb77916176 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
91392025-01-22T05:23:49.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 53de7bfe-8741-484e-b145-2fb88792f5e9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91402025-01-22T05:23:49.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 53de7bfe-8741-484e-b145-2fb88792f5e9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91412025-01-22T05:23:49.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 53de7bfe-8741-484e-b145-2fb88792f5e9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91422025-01-22T05:23:50.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 301506d0-b19a-4f3b-95f5-e678af724163 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91432025-01-22T05:23:50.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 301506d0-b19a-4f3b-95f5-e678af724163 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91442025-01-22T05:23:50.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 301506d0-b19a-4f3b-95f5-e678af724163 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91452025-01-22T05:23:51.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e880f0d1-db13-415e-b63b-16d6a0591ee8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91462025-01-22T05:23:51.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e880f0d1-db13-415e-b63b-16d6a0591ee8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91472025-01-22T05:23:51.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e880f0d1-db13-415e-b63b-16d6a0591ee8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91482025-01-22T05:23:52.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9ecc20fd-6932-4870-b9c3-8604be3aa2d7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91492025-01-22T05:23:52.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9ecc20fd-6932-4870-b9c3-8604be3aa2d7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91502025-01-22T05:23:52.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9ecc20fd-6932-4870-b9c3-8604be3aa2d7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91512025-01-22T05:23:52.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
91522025-01-22T05:23:52.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91532025-01-22T05:23:52.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91542025-01-22T05:23:52.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
91552025-01-22T05:23:52.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91562025-01-22T05:23:52.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91572025-01-22T05:23:52.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91582025-01-22T05:23:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91592025-01-22T05:23:52.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91602025-01-22T05:23:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91612025-01-22T05:23:52.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91622025-01-22T05:23:52.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91632025-01-22T05:23:52.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91642025-01-22T05:23:52.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
91652025-01-22T05:23:52.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91662025-01-22T05:23:52.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91672025-01-22T05:23:52.847ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
91682025-01-22T05:23:52.847ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.130441ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
91692025-01-22T05:23:52.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91702025-01-22T05:23:52.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91712025-01-22T05:23:52.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.942453ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91722025-01-22T05:23:53.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f4166f88-d186-49eb-a982-fcdc57fabf24 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91732025-01-22T05:23:53.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f4166f88-d186-49eb-a982-fcdc57fabf24 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91742025-01-22T05:23:53.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f4166f88-d186-49eb-a982-fcdc57fabf24 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91752025-01-22T05:23:54.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 26e5f16d-3551-4259-ba01-917dfd1b455c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91762025-01-22T05:23:54.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 26e5f16d-3551-4259-ba01-917dfd1b455c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91772025-01-22T05:23:54.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 26e5f16d-3551-4259-ba01-917dfd1b455c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91782025-01-22T05:23:55.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a9b7522e-5057-4f24-8b03-f368d3bd9304 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91792025-01-22T05:23:55.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a9b7522e-5057-4f24-8b03-f368d3bd9304 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91802025-01-22T05:23:55.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a9b7522e-5057-4f24-8b03-f368d3bd9304 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91812025-01-22T05:23:55.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 591 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 8b5c2e01-e56f-4a9d-b164-59c40c1f7372 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
91822025-01-22T05:23:56.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = adf49531-db7e-4efc-b625-d051d6e19f8a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91832025-01-22T05:23:56.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = adf49531-db7e-4efc-b625-d051d6e19f8a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91842025-01-22T05:23:56.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = adf49531-db7e-4efc-b625-d051d6e19f8a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91852025-01-22T05:23:57.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 43709368-c90b-4373-af61-f36b3a9f2e99 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91862025-01-22T05:23:57.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 43709368-c90b-4373-af61-f36b3a9f2e99 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91872025-01-22T05:23:57.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 43709368-c90b-4373-af61-f36b3a9f2e99 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91882025-01-22T05:23:58.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7943c377-be0a-4994-a5de-1b846e1dd6a2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91892025-01-22T05:23:58.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7943c377-be0a-4994-a5de-1b846e1dd6a2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91902025-01-22T05:23:58.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7943c377-be0a-4994-a5de-1b846e1dd6a2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91912025-01-22T05:23:59.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8defcf74-0fe8-4c26-a37d-379c801da300 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91922025-01-22T05:23:59.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8defcf74-0fe8-4c26-a37d-379c801da300 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91932025-01-22T05:23:59.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8defcf74-0fe8-4c26-a37d-379c801da300 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91942025-01-22T05:24:00.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 964f20d5-dac2-4cbd-aee9-40788dac312c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91952025-01-22T05:24:00.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 964f20d5-dac2-4cbd-aee9-40788dac312c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91962025-01-22T05:24:00.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 964f20d5-dac2-4cbd-aee9-40788dac312c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
91972025-01-22T05:24:00.975ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:51873
91982025-01-22T05:24:00.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = d61579ac-f042-45b5-8fd9-1fe82434d550 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
91992025-01-22T05:24:00.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = d61579ac-f042-45b5-8fd9-1fe82434d550 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
92002025-01-22T05:24:00.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = d61579ac-f042-45b5-8fd9-1fe82434d550 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
92012025-01-22T05:24:00.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = 5d358482-7840-4e96-bf76-ccee0f6a63d8 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
92022025-01-22T05:24:00.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = 5d358482-7840-4e96-bf76-ccee0f6a63d8 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
92032025-01-22T05:24:00.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = 5d358482-7840-4e96-bf76-ccee0f6a63d8 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
92042025-01-22T05:24:01.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b27b935f-1189-441e-a845-6b6839440d32 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
92052025-01-22T05:24:01.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b27b935f-1189-441e-a845-6b6839440d32 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
92062025-01-22T05:24:01.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b27b935f-1189-441e-a845-6b6839440d32 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
92072025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
92082025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
92092025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92102025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
92112025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
92122025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
92132025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92142025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
92152025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92162025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
92172025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92182025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
92192025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92202025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
92212025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
92222025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92232025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92242025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
92252025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92262025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
92272025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92282025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
92292025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92302025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92312025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
92322025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92332025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
92342025-01-22T05:24:02.825ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92352025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92362025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92372025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92382025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92392025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92402025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92412025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92422025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92432025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92442025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92452025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92462025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92472025-01-22T05:24:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92482025-01-22T05:24:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92492025-01-22T05:24:02.827ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92502025-01-22T05:24:02.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92512025-01-22T05:24:02.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92522025-01-22T05:24:02.829ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.90995ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92532025-01-22T05:24:02.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
92542025-01-22T05:24:02.829ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
92552025-01-22T05:24:02.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11625, tv_nsec: 176103312 } })
92562025-01-22T05:24:02.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92572025-01-22T05:24:02.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
92582025-01-22T05:24:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92592025-01-22T05:24:02.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92602025-01-22T05:24:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92612025-01-22T05:24:02.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92622025-01-22T05:24:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92632025-01-22T05:24:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92642025-01-22T05:24:02.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92652025-01-22T05:24:02.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92662025-01-22T05:24:02.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92672025-01-22T05:24:02.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92682025-01-22T05:24:02.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92692025-01-22T05:24:02.837ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11625, tv_nsec: 183378620 } })
92702025-01-22T05:24:02.837ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
92712025-01-22T05:24:02.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92722025-01-22T05:24:02.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92732025-01-22T05:24:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92742025-01-22T05:24:02.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92752025-01-22T05:24:02.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92762025-01-22T05:24:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92772025-01-22T05:24:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92782025-01-22T05:24:02.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92792025-01-22T05:24:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92802025-01-22T05:24:02.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92812025-01-22T05:24:02.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92822025-01-22T05:24:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92832025-01-22T05:24:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92842025-01-22T05:24:02.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92852025-01-22T05:24:02.842ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11625, tv_nsec: 188287920 } })
92862025-01-22T05:24:02.842ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
92872025-01-22T05:24:02.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92882025-01-22T05:24:02.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92892025-01-22T05:24:02.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92902025-01-22T05:24:02.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92912025-01-22T05:24:02.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92922025-01-22T05:24:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92932025-01-22T05:24:02.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92942025-01-22T05:24:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92952025-01-22T05:24:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
92962025-01-22T05:24:02.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92972025-01-22T05:24:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92982025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
92992025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
93002025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
93012025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93022025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
93032025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
93042025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
93052025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93062025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93072025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93082025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93092025-01-22T05:24:02.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93102025-01-22T05:24:02.855ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
93112025-01-22T05:24:02.855ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.265807ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
93122025-01-22T05:24:02.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93132025-01-22T05:24:02.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93142025-01-22T05:24:02.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93152025-01-22T05:24:02.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93162025-01-22T05:24:02.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93172025-01-22T05:24:02.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93182025-01-22T05:24:02.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fb039a9e-f16b-4d7e-8018-9c932677c829 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
93192025-01-22T05:24:02.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fb039a9e-f16b-4d7e-8018-9c932677c829 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
93202025-01-22T05:24:02.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 33.395771ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
93212025-01-22T05:24:02.881ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93222025-01-22T05:24:02.881ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93232025-01-22T05:24:02.881ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93242025-01-22T05:24:02.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93252025-01-22T05:24:02.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93262025-01-22T05:24:02.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93272025-01-22T05:24:02.889ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93282025-01-22T05:24:02.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93292025-01-22T05:24:02.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.753489ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93302025-01-22T05:24:02.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.254844ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
93312025-01-22T05:24:02.903ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93322025-01-22T05:24:02.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93332025-01-22T05:24:02.905ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93342025-01-22T05:24:02.905ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.350746ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93352025-01-22T05:24:02.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.090027ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93362025-01-22T05:24:02.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
93372025-01-22T05:24:02.931ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93382025-01-22T05:24:02.931ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4359153-d190-4f69-97f2-b1f9640aa064", "content-length": "26", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
93392025-01-22T05:24:02.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93402025-01-22T05:24:02.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93412025-01-22T05:24:02.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93422025-01-22T05:24:02.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93432025-01-22T05:24:02.946ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.584437ms iteration = 31 status = {"physical_disks_added":0}
93442025-01-22T05:24:02.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
93452025-01-22T05:24:02.960ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93462025-01-22T05:24:02.961ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd765c9e-6fb2-4a99-9e20-84802c97e78f", "content-length": "26", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
93472025-01-22T05:24:02.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93482025-01-22T05:24:02.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
93492025-01-22T05:24:03.050ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93502025-01-22T05:24:03.050ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b2e9bc9-af69-42f3-8a3e-52510449d4e2", "content-length": "2", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
93512025-01-22T05:24:03.052ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93522025-01-22T05:24:03.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93532025-01-22T05:24:03.072ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93542025-01-22T05:24:03.072ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93552025-01-22T05:24:03.072ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "730eefd5-431d-46b3-9db3-c69c331b7c31", "content-length": "372", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
93562025-01-22T05:24:03.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93572025-01-22T05:24:03.072ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
93582025-01-22T05:24:03.072ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93592025-01-22T05:24:03.073ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46ce0f7b-4745-4caf-b398-1d9154e4447d", "content-length": "26", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
93602025-01-22T05:24:03.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93612025-01-22T05:24:03.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93622025-01-22T05:24:03.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93632025-01-22T05:24:03.074ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93642025-01-22T05:24:03.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93652025-01-22T05:24:03.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fb039a9e-f16b-4d7e-8018-9c932677c829 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
93662025-01-22T05:24:03.077ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 252.091465ms iteration = 28 status = null
93672025-01-22T05:24:03.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93682025-01-22T05:24:03.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93692025-01-22T05:24:03.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93702025-01-22T05:24:03.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93712025-01-22T05:24:03.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 262.825344ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93722025-01-22T05:24:03.109ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93732025-01-22T05:24:03.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93742025-01-22T05:24:03.111ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93752025-01-22T05:24:03.111ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93762025-01-22T05:24:03.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93772025-01-22T05:24:03.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93782025-01-22T05:24:03.113ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93792025-01-22T05:24:03.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
93802025-01-22T05:24:03.115ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93812025-01-22T05:24:03.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93822025-01-22T05:24:03.122ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93832025-01-22T05:24:03.122ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93842025-01-22T05:24:03.122ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "764b9ecd-cb63-417e-89cb-f8ad3e416063", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
93852025-01-22T05:24:03.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93862025-01-22T05:24:03.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93872025-01-22T05:24:03.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93882025-01-22T05:24:03.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93892025-01-22T05:24:03.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93902025-01-22T05:24:03.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93912025-01-22T05:24:03.131ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93922025-01-22T05:24:03.131ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93932025-01-22T05:24:03.131ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "59bd5855-00b0-4a79-b61e-dbfc5a456873", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
93942025-01-22T05:24:03.133ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.008354ms iteration = 29 status = {}
93952025-01-22T05:24:03.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93962025-01-22T05:24:03.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
93972025-01-22T05:24:03.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93982025-01-22T05:24:03.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93992025-01-22T05:24:03.138ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 313.333363ms iteration = 28 status = 0
94002025-01-22T05:24:03.139ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 313.65893ms iteration = 28 status = {}
94012025-01-22T05:24:03.142ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94022025-01-22T05:24:03.142ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94032025-01-22T05:24:03.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 317.338315ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94042025-01-22T05:24:03.143ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
94052025-01-22T05:24:03.143ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 318.5854ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
94062025-01-22T05:24:03.145ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 299.394749ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
94072025-01-22T05:24:03.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94082025-01-22T05:24:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94092025-01-22T05:24:03.179ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
94102025-01-22T05:24:03.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94112025-01-22T05:24:03.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94122025-01-22T05:24:03.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94132025-01-22T05:24:03.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "25c0a3db-4af0-4c28-a509-46458f0f3003", "content-length": "134", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
94142025-01-22T05:24:03.188ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94152025-01-22T05:24:03.188ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
94162025-01-22T05:24:03.188ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94172025-01-22T05:24:03.188ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94182025-01-22T05:24:03.188ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94192025-01-22T05:24:03.188ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94202025-01-22T05:24:03.188ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94212025-01-22T05:24:03.188ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94222025-01-22T05:24:03.189ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94232025-01-22T05:24:03.189ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94242025-01-22T05:24:03.189ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
94252025-01-22T05:24:03.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94262025-01-22T05:24:03.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94272025-01-22T05:24:03.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94282025-01-22T05:24:03.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94292025-01-22T05:24:03.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94302025-01-22T05:24:03.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "782b23fd-fb9d-4ff6-b48f-837c0fc52e30", "content-length": "2", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
94312025-01-22T05:24:03.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94322025-01-22T05:24:03.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "18243aa8-07bd-4816-9735-661f29965df1", "content-length": "51", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
94332025-01-22T05:24:03.191ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
94342025-01-22T05:24:03.191ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94352025-01-22T05:24:03.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94362025-01-22T05:24:03.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94372025-01-22T05:24:03.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94382025-01-22T05:24:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94392025-01-22T05:24:03.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94402025-01-22T05:24:03.228ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94412025-01-22T05:24:03.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94422025-01-22T05:24:03.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94432025-01-22T05:24:03.293ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8d966bdb-dc1f-4c78-ae62-628080a0907e", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
94442025-01-22T05:24:03.293ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
94452025-01-22T05:24:03.293ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94462025-01-22T05:24:03.296ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "10fe68dc-d5ec-42a8-b308-99351a7116c6", "content-length": "682", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
94472025-01-22T05:24:03.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94482025-01-22T05:24:03.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94492025-01-22T05:24:03.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94502025-01-22T05:24:03.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94512025-01-22T05:24:03.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94522025-01-22T05:24:03.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94532025-01-22T05:24:03.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94542025-01-22T05:24:03.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94552025-01-22T05:24:03.315ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94562025-01-22T05:24:03.315ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2c4facf-67c1-4a99-acd0-d003beb8807d", "content-length": "691", "date": "Wed, 22 Jan 2025 05:24:02 GMT"} })
94572025-01-22T05:24:03.315ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
94582025-01-22T05:24:03.315ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
94592025-01-22T05:24:03.315ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
94602025-01-22T05:24:03.316ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 491.102894ms iteration = 29 status = {}
94612025-01-22T05:24:03.321ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 496.284279ms iteration = 28 status = {}
94622025-01-22T05:24:03.952ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
94632025-01-22T05:24:03.952ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
94642025-01-22T05:24:03.982ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
94652025-01-22T05:24:03.983ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:45189
94662025-01-22T05:24:03.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45189 req_id = ca0bf3f0-e70a-4dd6-8785-2892e0affb97 roles = RoleSet { roles: {} } uri = /metrics/producers
94672025-01-22T05:24:03.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45189 req_id = ca0bf3f0-e70a-4dd6-8785-2892e0affb97 resource = Database result = Ok(()) uri = /metrics/producers
94682025-01-22T05:24:04.022ZINFOnexus: assigned collector to new producer collector_id = 95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0 file = nexus/src/app/oximeter.rs:76 producer_id = 3fbe3917-aca1-4b36-8119-948b03a24746
94692025-01-22T05:24:04.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39423 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45189 req_id = ca0bf3f0-e70a-4dd6-8785-2892e0affb97 response_code = 201 uri = /metrics/producers
94702025-01-22T05:24:04.022ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ca0bf3f0-e70a-4dd6-8785-2892e0affb97", "content-length": "41", "date": "Wed, 22 Jan 2025 05:24:03 GMT"} })
94712025-01-22T05:24:04.024ZDEBGnexus (producer-registration-task): registered with nexus successfully
94722025-01-22T05:24:04.024ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
94732025-01-22T05:24:04.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 34ec5db9-a8cc-4ba0-97aa-339909d2effc roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94742025-01-22T05:24:04.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 34ec5db9-a8cc-4ba0-97aa-339909d2effc resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94752025-01-22T05:24:04.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 34ec5db9-a8cc-4ba0-97aa-339909d2effc response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94762025-01-22T05:24:05.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2f77c944-2059-4768-818d-3def9e4db2d3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94772025-01-22T05:24:05.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2f77c944-2059-4768-818d-3def9e4db2d3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94782025-01-22T05:24:05.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2f77c944-2059-4768-818d-3def9e4db2d3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94792025-01-22T05:24:05.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 491 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 1f1c3249-da52-4184-abd9-34585b35f888 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
94802025-01-22T05:24:06.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 73170d26-24d3-46ae-aa11-6b43b6fb7742 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94812025-01-22T05:24:06.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 73170d26-24d3-46ae-aa11-6b43b6fb7742 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94822025-01-22T05:24:06.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 73170d26-24d3-46ae-aa11-6b43b6fb7742 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94832025-01-22T05:24:07.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 24d3eb02-db12-4042-ae19-07f69f5cad04 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94842025-01-22T05:24:07.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 24d3eb02-db12-4042-ae19-07f69f5cad04 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94852025-01-22T05:24:07.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 24d3eb02-db12-4042-ae19-07f69f5cad04 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94862025-01-22T05:24:08.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c0c0c8b6-9a1c-4e1c-9b1c-08a9bde2ce11 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94872025-01-22T05:24:08.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c0c0c8b6-9a1c-4e1c-9b1c-08a9bde2ce11 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94882025-01-22T05:24:08.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c0c0c8b6-9a1c-4e1c-9b1c-08a9bde2ce11 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94892025-01-22T05:24:09.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8c3d9c07-bd40-49d8-973b-43560a056a76 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94902025-01-22T05:24:09.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8c3d9c07-bd40-49d8-973b-43560a056a76 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94912025-01-22T05:24:09.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8c3d9c07-bd40-49d8-973b-43560a056a76 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94922025-01-22T05:24:10.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b0f9d80d-7260-464c-a08f-ee6b8f7b6667 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94932025-01-22T05:24:10.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b0f9d80d-7260-464c-a08f-ee6b8f7b6667 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94942025-01-22T05:24:10.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b0f9d80d-7260-464c-a08f-ee6b8f7b6667 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94952025-01-22T05:24:11.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bfc0118c-214d-4fc4-9c3a-b6171a9abb81 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94962025-01-22T05:24:11.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bfc0118c-214d-4fc4-9c3a-b6171a9abb81 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94972025-01-22T05:24:11.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bfc0118c-214d-4fc4-9c3a-b6171a9abb81 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94982025-01-22T05:24:12.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e840d7af-297b-4c61-8a33-8e79d75626ec roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
94992025-01-22T05:24:12.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e840d7af-297b-4c61-8a33-8e79d75626ec resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95002025-01-22T05:24:12.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e840d7af-297b-4c61-8a33-8e79d75626ec response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95012025-01-22T05:24:12.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
95022025-01-22T05:24:12.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95032025-01-22T05:24:12.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95042025-01-22T05:24:12.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
95052025-01-22T05:24:12.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95062025-01-22T05:24:12.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95072025-01-22T05:24:12.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95082025-01-22T05:24:12.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95092025-01-22T05:24:12.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95102025-01-22T05:24:12.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95112025-01-22T05:24:12.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95122025-01-22T05:24:12.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95132025-01-22T05:24:12.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95142025-01-22T05:24:12.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95152025-01-22T05:24:12.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.081894ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95162025-01-22T05:24:12.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95172025-01-22T05:24:12.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
95182025-01-22T05:24:12.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95192025-01-22T05:24:12.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95202025-01-22T05:24:12.909ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
95212025-01-22T05:24:12.909ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.500801ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
95222025-01-22T05:24:13.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b450f1a0-8f5d-4ed5-b711-6eca65e4895c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95232025-01-22T05:24:13.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b450f1a0-8f5d-4ed5-b711-6eca65e4895c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95242025-01-22T05:24:13.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b450f1a0-8f5d-4ed5-b711-6eca65e4895c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95252025-01-22T05:24:14.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 99248c74-1338-4103-9347-028a6324b470 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95262025-01-22T05:24:14.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 99248c74-1338-4103-9347-028a6324b470 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95272025-01-22T05:24:14.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 99248c74-1338-4103-9347-028a6324b470 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95282025-01-22T05:24:15.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 199b7b80-437d-4c6b-99c5-69c01b4259cd roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95292025-01-22T05:24:15.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 199b7b80-437d-4c6b-99c5-69c01b4259cd resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95302025-01-22T05:24:15.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 199b7b80-437d-4c6b-99c5-69c01b4259cd response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95312025-01-22T05:24:15.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 73b83ea9-8245-418a-88ef-4fcee86e9dcb response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
95322025-01-22T05:24:16.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4dea4fd8-b22a-431b-8cc8-1f2cdf3ab6ba roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95332025-01-22T05:24:16.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4dea4fd8-b22a-431b-8cc8-1f2cdf3ab6ba resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95342025-01-22T05:24:16.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4dea4fd8-b22a-431b-8cc8-1f2cdf3ab6ba response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95352025-01-22T05:24:17.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4e724dc8-84ff-46b1-832f-d1e3444f781b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95362025-01-22T05:24:17.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4e724dc8-84ff-46b1-832f-d1e3444f781b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95372025-01-22T05:24:17.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4e724dc8-84ff-46b1-832f-d1e3444f781b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95382025-01-22T05:24:18.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5978d6e2-081a-48c8-897a-db369e2457d4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95392025-01-22T05:24:18.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5978d6e2-081a-48c8-897a-db369e2457d4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95402025-01-22T05:24:18.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5978d6e2-081a-48c8-897a-db369e2457d4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95412025-01-22T05:24:19.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 9713b318-f17d-4401-88de-92f757ad419c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
95422025-01-22T05:24:19.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 9713b318-f17d-4401-88de-92f757ad419c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
95432025-01-22T05:24:19.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 9713b318-f17d-4401-88de-92f757ad419c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
95442025-01-22T05:24:19.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b3105ed0-81f3-4509-91ad-1b035e7c1d85 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95452025-01-22T05:24:19.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b3105ed0-81f3-4509-91ad-1b035e7c1d85 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95462025-01-22T05:24:19.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b3105ed0-81f3-4509-91ad-1b035e7c1d85 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95472025-01-22T05:24:20.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f21598ed-544c-4c18-8e45-ffbf82a57cf5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95482025-01-22T05:24:20.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f21598ed-544c-4c18-8e45-ffbf82a57cf5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95492025-01-22T05:24:20.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f21598ed-544c-4c18-8e45-ffbf82a57cf5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95502025-01-22T05:24:21.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3143abe5-febd-435e-a969-a468489e1d04 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95512025-01-22T05:24:21.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3143abe5-febd-435e-a969-a468489e1d04 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95522025-01-22T05:24:21.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3143abe5-febd-435e-a969-a468489e1d04 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95532025-01-22T05:24:22.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d571595-08ff-4f03-87d5-f9fbb0b0132f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95542025-01-22T05:24:22.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d571595-08ff-4f03-87d5-f9fbb0b0132f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95552025-01-22T05:24:22.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d571595-08ff-4f03-87d5-f9fbb0b0132f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95562025-01-22T05:24:22.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
95572025-01-22T05:24:22.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95582025-01-22T05:24:22.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95592025-01-22T05:24:22.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
95602025-01-22T05:24:22.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95612025-01-22T05:24:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95622025-01-22T05:24:22.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95632025-01-22T05:24:22.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95642025-01-22T05:24:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95652025-01-22T05:24:22.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95662025-01-22T05:24:22.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95672025-01-22T05:24:22.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95682025-01-22T05:24:22.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95692025-01-22T05:24:22.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
95702025-01-22T05:24:22.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95712025-01-22T05:24:22.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95722025-01-22T05:24:22.846ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
95732025-01-22T05:24:22.846ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.497998ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
95742025-01-22T05:24:22.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95752025-01-22T05:24:22.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95762025-01-22T05:24:22.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.301487ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95772025-01-22T05:24:23.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d42b680-4772-47bd-bcda-361f33b3b22f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95782025-01-22T05:24:23.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d42b680-4772-47bd-bcda-361f33b3b22f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95792025-01-22T05:24:23.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1d42b680-4772-47bd-bcda-361f33b3b22f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95802025-01-22T05:24:24.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a21282a6-f56e-4e82-84f8-d6f0e9e24487 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95812025-01-22T05:24:24.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a21282a6-f56e-4e82-84f8-d6f0e9e24487 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95822025-01-22T05:24:24.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a21282a6-f56e-4e82-84f8-d6f0e9e24487 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95832025-01-22T05:24:25.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7c5ccb36-74d4-4bf7-b6c8-2463ebfd521e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95842025-01-22T05:24:25.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7c5ccb36-74d4-4bf7-b6c8-2463ebfd521e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95852025-01-22T05:24:25.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7c5ccb36-74d4-4bf7-b6c8-2463ebfd521e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95862025-01-22T05:24:25.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 855 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = be1b0ffc-97b3-4036-b24e-1a0732cdf24f response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
95872025-01-22T05:24:26.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9e6c292f-400d-434d-9db8-1addd1908687 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95882025-01-22T05:24:26.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9e6c292f-400d-434d-9db8-1addd1908687 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95892025-01-22T05:24:26.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9e6c292f-400d-434d-9db8-1addd1908687 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95902025-01-22T05:24:27.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1638a099-7523-4adf-9f6d-dee3dfe50862 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95912025-01-22T05:24:27.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1638a099-7523-4adf-9f6d-dee3dfe50862 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95922025-01-22T05:24:27.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 1638a099-7523-4adf-9f6d-dee3dfe50862 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95932025-01-22T05:24:28.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e20c27f2-cbf6-47a3-b919-ca59a78e143d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95942025-01-22T05:24:28.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e20c27f2-cbf6-47a3-b919-ca59a78e143d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95952025-01-22T05:24:28.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e20c27f2-cbf6-47a3-b919-ca59a78e143d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95962025-01-22T05:24:29.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ac507052-d805-46aa-b7ab-cb536bcc4929 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95972025-01-22T05:24:29.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ac507052-d805-46aa-b7ab-cb536bcc4929 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95982025-01-22T05:24:29.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ac507052-d805-46aa-b7ab-cb536bcc4929 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
95992025-01-22T05:24:30.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9e8a094b-5207-4cd6-a0f0-9c507093b7fb roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
96002025-01-22T05:24:30.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9e8a094b-5207-4cd6-a0f0-9c507093b7fb resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
96012025-01-22T05:24:30.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9e8a094b-5207-4cd6-a0f0-9c507093b7fb response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
96022025-01-22T05:24:31.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b94a1500-16f9-44a2-8e15-2ea41cafc33f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
96032025-01-22T05:24:31.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b94a1500-16f9-44a2-8e15-2ea41cafc33f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
96042025-01-22T05:24:31.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b94a1500-16f9-44a2-8e15-2ea41cafc33f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
96052025-01-22T05:24:32.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bd2444ac-6896-426f-be87-28cd7959b9e1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
96062025-01-22T05:24:32.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bd2444ac-6896-426f-be87-28cd7959b9e1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
96072025-01-22T05:24:32.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = bd2444ac-6896-426f-be87-28cd7959b9e1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
96082025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
96092025-01-22T05:24:32.824ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96102025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
96112025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96122025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
96132025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96142025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96152025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
96162025-01-22T05:24:32.824ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:14:32.824675676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96172025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
96182025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96192025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96202025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
96212025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
96222025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
96232025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
96242025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96252025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96262025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
96272025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96282025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
96292025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
96302025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
96312025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96322025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96332025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
96342025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96352025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
96362025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
96372025-01-22T05:24:32.824ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
96382025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
96392025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.951\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
96402025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
96412025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96422025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96432025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96442025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
96452025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96462025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
96472025-01-22T05:24:32.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96482025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96492025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96502025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96512025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96522025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96532025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96542025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96552025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96562025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96572025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96582025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96592025-01-22T05:24:32.825ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11655, tv_nsec: 171222433 } })
96602025-01-22T05:24:32.825ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11655, tv_nsec: 171253213 } })
96612025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96622025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96632025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96642025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
96652025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
96662025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96672025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96682025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
96692025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96702025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96712025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
96722025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96732025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
96742025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96752025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
96762025-01-22T05:24:32.825ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96772025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96782025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
96792025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
96802025-01-22T05:24:32.825ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.213024ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
96812025-01-22T05:24:32.826ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.264526ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
96822025-01-22T05:24:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96832025-01-22T05:24:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96842025-01-22T05:24:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96852025-01-22T05:24:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96862025-01-22T05:24:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96872025-01-22T05:24:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96882025-01-22T05:24:32.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96892025-01-22T05:24:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96902025-01-22T05:24:32.828ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96912025-01-22T05:24:32.828ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.279047ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96922025-01-22T05:24:32.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96932025-01-22T05:24:32.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11655, tv_nsec: 175303646 } })
96942025-01-22T05:24:32.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
96952025-01-22T05:24:32.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96962025-01-22T05:24:32.829ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96972025-01-22T05:24:32.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96982025-01-22T05:24:32.830ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:14:32.824675676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96992025-01-22T05:24:32.830ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.178525ms iteration = 15 status = {"expiration":"2025-01-22T05:14:32.824675676Z","pruned":[]}
97002025-01-22T05:24:32.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97012025-01-22T05:24:32.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97022025-01-22T05:24:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97032025-01-22T05:24:32.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97042025-01-22T05:24:32.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97052025-01-22T05:24:32.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97062025-01-22T05:24:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97072025-01-22T05:24:32.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97082025-01-22T05:24:32.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97092025-01-22T05:24:32.835ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11655, tv_nsec: 181054653 } })
97102025-01-22T05:24:32.835ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
97112025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97122025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
97132025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
97142025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97152025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
97162025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97172025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
97182025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
97192025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97202025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
97212025-01-22T05:24:32.846ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
97222025-01-22T05:24:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97232025-01-22T05:24:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97242025-01-22T05:24:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97252025-01-22T05:24:32.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11655, tv_nsec: 193227631 } })
97262025-01-22T05:24:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97272025-01-22T05:24:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97282025-01-22T05:24:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97292025-01-22T05:24:32.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
97302025-01-22T05:24:32.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97312025-01-22T05:24:32.871ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97322025-01-22T05:24:32.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97332025-01-22T05:24:32.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
97342025-01-22T05:24:32.874ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97352025-01-22T05:24:32.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97362025-01-22T05:24:32.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97372025-01-22T05:24:32.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97382025-01-22T05:24:32.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97392025-01-22T05:24:32.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97402025-01-22T05:24:32.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97412025-01-22T05:24:32.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97422025-01-22T05:24:32.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97432025-01-22T05:24:32.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97442025-01-22T05:24:32.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97452025-01-22T05:24:32.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97462025-01-22T05:24:32.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97472025-01-22T05:24:32.879ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 32.661825ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
97482025-01-22T05:24:32.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97492025-01-22T05:24:32.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97502025-01-22T05:24:32.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97512025-01-22T05:24:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97522025-01-22T05:24:32.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97532025-01-22T05:24:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97542025-01-22T05:24:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97552025-01-22T05:24:32.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97562025-01-22T05:24:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97572025-01-22T05:24:32.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97582025-01-22T05:24:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97592025-01-22T05:24:32.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97602025-01-22T05:24:32.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97612025-01-22T05:24:32.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97622025-01-22T05:24:32.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97632025-01-22T05:24:32.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97642025-01-22T05:24:32.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97652025-01-22T05:24:32.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97662025-01-22T05:24:32.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97672025-01-22T05:24:32.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97682025-01-22T05:24:32.886ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97692025-01-22T05:24:32.886ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97702025-01-22T05:24:32.886ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.043104ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97712025-01-22T05:24:32.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97722025-01-22T05:24:32.887ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97732025-01-22T05:24:32.887ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97742025-01-22T05:24:32.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97752025-01-22T05:24:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97762025-01-22T05:24:32.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97772025-01-22T05:24:32.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97782025-01-22T05:24:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97792025-01-22T05:24:32.889ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97802025-01-22T05:24:32.889ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97812025-01-22T05:24:32.889ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.904022ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97822025-01-22T05:24:32.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97832025-01-22T05:24:32.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97842025-01-22T05:24:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97852025-01-22T05:24:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97862025-01-22T05:24:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97872025-01-22T05:24:32.895ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97882025-01-22T05:24:32.895ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97892025-01-22T05:24:32.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97902025-01-22T05:24:32.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97912025-01-22T05:24:32.896ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97922025-01-22T05:24:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97932025-01-22T05:24:32.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97942025-01-22T05:24:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97952025-01-22T05:24:32.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97962025-01-22T05:24:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97972025-01-22T05:24:32.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97982025-01-22T05:24:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97992025-01-22T05:24:32.929ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98002025-01-22T05:24:32.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98012025-01-22T05:24:32.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.553702ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
98022025-01-22T05:24:32.931ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98032025-01-22T05:24:32.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
98042025-01-22T05:24:32.934ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98052025-01-22T05:24:32.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98062025-01-22T05:24:32.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.771199ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98072025-01-22T05:24:32.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98082025-01-22T05:24:32.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98092025-01-22T05:24:32.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 95.133408ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
98102025-01-22T05:24:32.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98112025-01-22T05:24:32.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98122025-01-22T05:24:32.951ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98132025-01-22T05:24:32.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.984889ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98142025-01-22T05:24:32.953ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98152025-01-22T05:24:32.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98162025-01-22T05:24:32.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
98172025-01-22T05:24:32.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98182025-01-22T05:24:32.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98192025-01-22T05:24:32.956ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98202025-01-22T05:24:32.956ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98212025-01-22T05:24:32.956ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98222025-01-22T05:24:32.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98232025-01-22T05:24:32.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98242025-01-22T05:24:32.958ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98252025-01-22T05:24:32.958ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98262025-01-22T05:24:32.958ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.52284ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98272025-01-22T05:24:32.958ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 133.53118ms iteration = 29 status = 0
98282025-01-22T05:24:32.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98292025-01-22T05:24:32.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98302025-01-22T05:24:32.959ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98312025-01-22T05:24:32.959ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 133.693504ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98322025-01-22T05:24:32.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 133.829547ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98332025-01-22T05:24:32.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98342025-01-22T05:24:32.960ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98352025-01-22T05:24:32.960ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98362025-01-22T05:24:32.960ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98372025-01-22T05:24:32.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98382025-01-22T05:24:32.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98392025-01-22T05:24:32.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98402025-01-22T05:24:32.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98412025-01-22T05:24:32.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98422025-01-22T05:24:32.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98432025-01-22T05:24:32.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
98442025-01-22T05:24:32.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98452025-01-22T05:24:32.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98462025-01-22T05:24:32.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 117.079285ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98472025-01-22T05:24:32.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98482025-01-22T05:24:32.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98492025-01-22T05:24:32.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98502025-01-22T05:24:32.965ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98512025-01-22T05:24:32.965ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
98522025-01-22T05:24:32.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98532025-01-22T05:24:32.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98542025-01-22T05:24:32.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98552025-01-22T05:24:32.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98562025-01-22T05:24:32.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98572025-01-22T05:24:32.972ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98582025-01-22T05:24:32.972ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98592025-01-22T05:24:32.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98602025-01-22T05:24:32.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98612025-01-22T05:24:32.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98622025-01-22T05:24:32.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98632025-01-22T05:24:32.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98642025-01-22T05:24:32.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98652025-01-22T05:24:32.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98662025-01-22T05:24:32.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98672025-01-22T05:24:32.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98682025-01-22T05:24:32.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98692025-01-22T05:24:32.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98702025-01-22T05:24:32.978ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
98712025-01-22T05:24:32.978ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 153.986437ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
98722025-01-22T05:24:32.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
98732025-01-22T05:24:32.979ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98742025-01-22T05:24:32.980ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
98752025-01-22T05:24:32.980ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98762025-01-22T05:24:32.980ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
98772025-01-22T05:24:32.980ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 155.413056ms iteration = 15 status = {"generation":2}
98782025-01-22T05:24:32.980ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "695d0f96-f6d8-4425-8173-0664bd260370", "content-length": "26", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} })
98792025-01-22T05:24:32.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98802025-01-22T05:24:32.980ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
98812025-01-22T05:24:32.980ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 155.463867ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
98822025-01-22T05:24:32.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98832025-01-22T05:24:32.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98842025-01-22T05:24:32.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98852025-01-22T05:24:32.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98862025-01-22T05:24:32.984ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
98872025-01-22T05:24:32.984ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98882025-01-22T05:24:32.984ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
98892025-01-22T05:24:32.984ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 159.850317ms iteration = 15 status = {"generation":1}
98902025-01-22T05:24:32.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98912025-01-22T05:24:33.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98922025-01-22T05:24:33.017ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
98932025-01-22T05:24:33.017ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 192.464081ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98942025-01-22T05:24:33.039ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 214.664313ms iteration = 32 status = {"physical_disks_added":0}
98952025-01-22T05:24:33.064ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98962025-01-22T05:24:33.064ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 238.360376ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98972025-01-22T05:24:33.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98982025-01-22T05:24:33.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98992025-01-22T05:24:33.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99002025-01-22T05:24:33.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99012025-01-22T05:24:33.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99022025-01-22T05:24:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99032025-01-22T05:24:33.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99042025-01-22T05:24:33.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99052025-01-22T05:24:33.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99062025-01-22T05:24:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99072025-01-22T05:24:33.087ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99082025-01-22T05:24:33.092ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
99092025-01-22T05:24:33.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
99102025-01-22T05:24:33.156ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99112025-01-22T05:24:33.156ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b45cc8a2-aeb0-4027-bf85-9ef0932c0db9", "content-length": "26", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} })
99122025-01-22T05:24:33.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99132025-01-22T05:24:33.159ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99142025-01-22T05:24:33.159ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99152025-01-22T05:24:33.160ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
99162025-01-22T05:24:33.161ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 336.656388ms iteration = 29 status = {}
99172025-01-22T05:24:33.181ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
99182025-01-22T05:24:33.181ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99192025-01-22T05:24:33.181ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22a8cb0c-609b-4489-a21c-934828a30159", "content-length": "26", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} })
99202025-01-22T05:24:33.181ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99212025-01-22T05:24:33.182ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99222025-01-22T05:24:33.186ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c729f92-7e80-4fdd-b987-0281dc79f921", "content-length": "372", "date": "Wed, 22 Jan 2025 05:24:33 GMT"} })
99232025-01-22T05:24:33.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99242025-01-22T05:24:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99252025-01-22T05:24:33.233ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99262025-01-22T05:24:33.233ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99272025-01-22T05:24:33.234ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e733d6c9-6b11-4fba-a3eb-5cabebd494eb", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} })
99282025-01-22T05:24:33.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99292025-01-22T05:24:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99302025-01-22T05:24:33.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99312025-01-22T05:24:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99322025-01-22T05:24:33.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99332025-01-22T05:24:33.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99342025-01-22T05:24:33.243ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99352025-01-22T05:24:33.243ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99362025-01-22T05:24:33.243ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3ac7f49f-c0ed-44f8-935a-1c97915ed8a7", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} })
99372025-01-22T05:24:33.245ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 419.795231ms iteration = 30 status = {}
99382025-01-22T05:24:33.261ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99392025-01-22T05:24:33.261ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "32d96c6d-836c-47b7-a0ae-b09bd6b86873", "content-length": "691", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} })
99402025-01-22T05:24:33.261ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99412025-01-22T05:24:33.261ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99422025-01-22T05:24:33.261ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99432025-01-22T05:24:33.263ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 438.38286ms iteration = 30 status = {}
99442025-01-22T05:24:33.287ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99452025-01-22T05:24:33.288ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "92bc290a-2636-4bf9-a5c9-8e0cd74c3367", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99462025-01-22T05:24:33.288ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99472025-01-22T05:24:33.290ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b73a2178-b283-4acd-9b8a-a81e948139b6", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99482025-01-22T05:24:33.290ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99492025-01-22T05:24:33.291ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99502025-01-22T05:24:33.291ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 466.691627ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99512025-01-22T05:24:33.314ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99522025-01-22T05:24:33.314ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8af4eddc-6ec4-43b9-8db6-1c851b60a03c", "content-length": "2", "date": "Wed, 22 Jan 2025 05:24:33 GMT"} })
99532025-01-22T05:24:33.315ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99542025-01-22T05:24:33.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99552025-01-22T05:24:33.317ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 492.974483ms iteration = 29 status = null
99562025-01-22T05:24:33.331ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
99572025-01-22T05:24:33.450ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99582025-01-22T05:24:33.450ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2beb918f-8f05-49ec-aed7-2993ecbc2390", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99592025-01-22T05:24:33.450ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99602025-01-22T05:24:33.452ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "84e4cc45-cb5f-410b-b050-1a865aaab84f", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99612025-01-22T05:24:33.452ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99622025-01-22T05:24:33.454ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bec89e38-902b-4fd3-8299-ae58b96c1ee2", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99632025-01-22T05:24:33.454ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99642025-01-22T05:24:33.457ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
99652025-01-22T05:24:33.457ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 632.497574ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99662025-01-22T05:24:33.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99672025-01-22T05:24:33.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99682025-01-22T05:24:33.489ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
99692025-01-22T05:24:33.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99702025-01-22T05:24:33.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99712025-01-22T05:24:33.499ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99722025-01-22T05:24:33.499ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e7ff6ff-27c3-4c89-9a90-3c8b63bf05eb", "content-length": "134", "date": "Wed, 22 Jan 2025 05:24:33 GMT"} })
99732025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99742025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
99752025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99762025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99772025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99782025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99792025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99802025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99812025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99822025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99832025-01-22T05:24:33.499ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
99842025-01-22T05:24:33.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99852025-01-22T05:24:33.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99862025-01-22T05:24:33.502ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99872025-01-22T05:24:33.502ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "aec346a1-3232-461e-855b-853ac8c706a6", "content-length": "2", "date": "Wed, 22 Jan 2025 05:24:33 GMT"} })
99882025-01-22T05:24:33.502ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99892025-01-22T05:24:33.502ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c560303-6555-4572-85a4-325972d60964", "content-length": "51", "date": "Wed, 22 Jan 2025 05:24:33 GMT"} })
99902025-01-22T05:24:33.502ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
99912025-01-22T05:24:33.502ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99922025-01-22T05:24:33.579ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "10464956-565c-4e0f-ac40-87633c2f9044", "date": "Wed, 22 Jan 2025 05:24:32 GMT"} })
99932025-01-22T05:24:33.579ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
99942025-01-22T05:24:33.579ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99952025-01-22T05:24:33.579ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e194ffe-3efd-4c95-ba10-d66d64940fb2", "content-length": "682", "date": "Wed, 22 Jan 2025 05:24:33 GMT"} })
99962025-01-22T05:24:33.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99972025-01-22T05:24:33.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99982025-01-22T05:24:33.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99992025-01-22T05:24:33.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100002025-01-22T05:24:33.586ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100012025-01-22T05:24:33.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100022025-01-22T05:24:33.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100032025-01-22T05:24:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100042025-01-22T05:24:33.596ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 772.033136ms iteration = 29 status = {}
100052025-01-22T05:24:33.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8f512fb2-e1da-45b9-a31f-d8422fa42f28 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100062025-01-22T05:24:33.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8f512fb2-e1da-45b9-a31f-d8422fa42f28 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100072025-01-22T05:24:33.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8f512fb2-e1da-45b9-a31f-d8422fa42f28 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100082025-01-22T05:24:34.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e2ebf84b-6b32-4203-b4f7-59e7c0b5d7a1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100092025-01-22T05:24:34.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e2ebf84b-6b32-4203-b4f7-59e7c0b5d7a1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100102025-01-22T05:24:34.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e2ebf84b-6b32-4203-b4f7-59e7c0b5d7a1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100112025-01-22T05:24:35.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dd76084c-b1ae-4a16-8538-12c9b7c6ead7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100122025-01-22T05:24:35.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dd76084c-b1ae-4a16-8538-12c9b7c6ead7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100132025-01-22T05:24:35.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = dd76084c-b1ae-4a16-8538-12c9b7c6ead7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100142025-01-22T05:24:35.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 514edb7e-2427-416d-8d91-f71098932fda response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
100152025-01-22T05:24:36.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0fe5a5fa-aab9-414a-a992-9f0d06b6d422 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100162025-01-22T05:24:36.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0fe5a5fa-aab9-414a-a992-9f0d06b6d422 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100172025-01-22T05:24:36.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0fe5a5fa-aab9-414a-a992-9f0d06b6d422 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100182025-01-22T05:24:37.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 31376e7a-519f-4406-9868-8564be1f6f0f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100192025-01-22T05:24:37.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 31376e7a-519f-4406-9868-8564be1f6f0f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100202025-01-22T05:24:37.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 31376e7a-519f-4406-9868-8564be1f6f0f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100212025-01-22T05:24:38.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 71e83b58-1606-4bc3-bc41-2fc682af82da roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100222025-01-22T05:24:38.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 71e83b58-1606-4bc3-bc41-2fc682af82da resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100232025-01-22T05:24:38.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 71e83b58-1606-4bc3-bc41-2fc682af82da response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100242025-01-22T05:24:39.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f3e40f8a-deac-46cc-853f-d31b4a673bf2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100252025-01-22T05:24:39.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f3e40f8a-deac-46cc-853f-d31b4a673bf2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100262025-01-22T05:24:39.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f3e40f8a-deac-46cc-853f-d31b4a673bf2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100272025-01-22T05:24:40.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4f10119c-2d5d-46f8-a975-2bf1ff8cb5c8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100282025-01-22T05:24:40.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4f10119c-2d5d-46f8-a975-2bf1ff8cb5c8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100292025-01-22T05:24:40.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4f10119c-2d5d-46f8-a975-2bf1ff8cb5c8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100302025-01-22T05:24:41.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2aafef66-7416-4231-abe0-0b6080e1c203 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100312025-01-22T05:24:41.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2aafef66-7416-4231-abe0-0b6080e1c203 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100322025-01-22T05:24:41.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 2aafef66-7416-4231-abe0-0b6080e1c203 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100332025-01-22T05:24:42.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
100342025-01-22T05:24:42.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100352025-01-22T05:24:42.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100362025-01-22T05:24:42.826ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
100372025-01-22T05:24:42.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100382025-01-22T05:24:42.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100392025-01-22T05:24:42.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100402025-01-22T05:24:42.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100412025-01-22T05:24:42.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100422025-01-22T05:24:42.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100432025-01-22T05:24:42.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100442025-01-22T05:24:42.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100452025-01-22T05:24:42.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100462025-01-22T05:24:42.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
100472025-01-22T05:24:42.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100482025-01-22T05:24:42.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100492025-01-22T05:24:42.848ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
100502025-01-22T05:24:42.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.831195ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
100512025-01-22T05:24:42.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100522025-01-22T05:24:42.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100532025-01-22T05:24:42.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.108373ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100542025-01-22T05:24:42.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4f8102fc-2668-46d7-8335-4d7c73e82f34 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100552025-01-22T05:24:42.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4f8102fc-2668-46d7-8335-4d7c73e82f34 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100562025-01-22T05:24:42.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4f8102fc-2668-46d7-8335-4d7c73e82f34 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100572025-01-22T05:24:43.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6927d5a8-59f2-41c9-abb7-a0493e352147 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100582025-01-22T05:24:43.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6927d5a8-59f2-41c9-abb7-a0493e352147 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100592025-01-22T05:24:43.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6927d5a8-59f2-41c9-abb7-a0493e352147 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100602025-01-22T05:24:44.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 90cb15cc-71fd-4dff-863b-1cf0646e4f5c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100612025-01-22T05:24:44.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 90cb15cc-71fd-4dff-863b-1cf0646e4f5c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100622025-01-22T05:24:44.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 90cb15cc-71fd-4dff-863b-1cf0646e4f5c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100632025-01-22T05:24:45.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 895 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 8b218f12-6e28-4a7b-8178-b01e1ba6c0c1 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
100642025-01-22T05:24:45.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7b0d5f9c-3e23-4bbf-9e5d-245e7614e3a3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100652025-01-22T05:24:45.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7b0d5f9c-3e23-4bbf-9e5d-245e7614e3a3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100662025-01-22T05:24:45.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7b0d5f9c-3e23-4bbf-9e5d-245e7614e3a3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100672025-01-22T05:24:47.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d62e5a27-e2d3-41e9-a622-222c344deae5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100682025-01-22T05:24:47.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d62e5a27-e2d3-41e9-a622-222c344deae5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100692025-01-22T05:24:47.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d62e5a27-e2d3-41e9-a622-222c344deae5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100702025-01-22T05:24:48.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 46b9566d-e518-45e8-8eef-897e1d808c81 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100712025-01-22T05:24:48.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 46b9566d-e518-45e8-8eef-897e1d808c81 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100722025-01-22T05:24:48.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 46b9566d-e518-45e8-8eef-897e1d808c81 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100732025-01-22T05:24:49.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 74c37dc0-3e84-4c70-a434-863f8f97e07b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100742025-01-22T05:24:49.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 74c37dc0-3e84-4c70-a434-863f8f97e07b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100752025-01-22T05:24:49.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 74c37dc0-3e84-4c70-a434-863f8f97e07b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100762025-01-22T05:24:49.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 9e4c887f-a20f-4e3c-ad04-0a46820a1d3e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
100772025-01-22T05:24:49.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 9e4c887f-a20f-4e3c-ad04-0a46820a1d3e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
100782025-01-22T05:24:49.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 9e4c887f-a20f-4e3c-ad04-0a46820a1d3e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
100792025-01-22T05:24:50.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8694875e-23cf-42a1-abf2-077319513e68 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100802025-01-22T05:24:50.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8694875e-23cf-42a1-abf2-077319513e68 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100812025-01-22T05:24:50.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8694875e-23cf-42a1-abf2-077319513e68 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100822025-01-22T05:24:51.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 081da5ad-0f93-4055-bac1-b6e1ea15a7f5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100832025-01-22T05:24:51.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 081da5ad-0f93-4055-bac1-b6e1ea15a7f5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100842025-01-22T05:24:51.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 081da5ad-0f93-4055-bac1-b6e1ea15a7f5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100852025-01-22T05:24:52.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 10793fd4-59e3-4985-a3e1-ff6516771762 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100862025-01-22T05:24:52.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 10793fd4-59e3-4985-a3e1-ff6516771762 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100872025-01-22T05:24:52.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 10793fd4-59e3-4985-a3e1-ff6516771762 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
100882025-01-22T05:24:52.824ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
100892025-01-22T05:24:52.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100902025-01-22T05:24:52.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100912025-01-22T05:24:52.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100922025-01-22T05:24:52.826ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
100932025-01-22T05:24:52.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100942025-01-22T05:24:52.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100952025-01-22T05:24:52.828ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100962025-01-22T05:24:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100972025-01-22T05:24:52.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100982025-01-22T05:24:52.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100992025-01-22T05:24:52.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101002025-01-22T05:24:52.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101012025-01-22T05:24:52.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101022025-01-22T05:24:52.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101032025-01-22T05:24:52.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
101042025-01-22T05:24:52.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101052025-01-22T05:24:52.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101062025-01-22T05:24:52.845ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
101072025-01-22T05:24:52.845ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.976778ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
101082025-01-22T05:24:52.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.41118ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101092025-01-22T05:24:53.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cde739f3-46ef-476b-9a75-ea3f32c77d07 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101102025-01-22T05:24:53.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cde739f3-46ef-476b-9a75-ea3f32c77d07 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101112025-01-22T05:24:53.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cde739f3-46ef-476b-9a75-ea3f32c77d07 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101122025-01-22T05:24:54.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c5b7b230-c703-48c7-bd5c-4fe7c05f33d7 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101132025-01-22T05:24:54.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c5b7b230-c703-48c7-bd5c-4fe7c05f33d7 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101142025-01-22T05:24:54.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c5b7b230-c703-48c7-bd5c-4fe7c05f33d7 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101152025-01-22T05:24:55.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9fde8124-c2f9-45c2-86f2-7911060923fa roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101162025-01-22T05:24:55.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9fde8124-c2f9-45c2-86f2-7911060923fa resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101172025-01-22T05:24:55.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9fde8124-c2f9-45c2-86f2-7911060923fa response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101182025-01-22T05:24:55.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = d8e25b44-6a72-4697-9475-87a16282e157 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
101192025-01-22T05:24:56.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 057853b7-168f-47cf-b5cb-6ca6d7bc9593 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101202025-01-22T05:24:56.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 057853b7-168f-47cf-b5cb-6ca6d7bc9593 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101212025-01-22T05:24:56.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 057853b7-168f-47cf-b5cb-6ca6d7bc9593 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101222025-01-22T05:24:57.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ed7b627f-e58c-4d4e-8520-43fa04123ace roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101232025-01-22T05:24:57.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ed7b627f-e58c-4d4e-8520-43fa04123ace resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101242025-01-22T05:24:57.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ed7b627f-e58c-4d4e-8520-43fa04123ace response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101252025-01-22T05:24:58.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8612f728-41ba-4f09-94ba-e9c16c79d12f roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101262025-01-22T05:24:58.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8612f728-41ba-4f09-94ba-e9c16c79d12f resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101272025-01-22T05:24:58.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8612f728-41ba-4f09-94ba-e9c16c79d12f response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101282025-01-22T05:24:59.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e356c59e-c00f-4bb3-8ee1-ce1528306df5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101292025-01-22T05:24:59.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e356c59e-c00f-4bb3-8ee1-ce1528306df5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101302025-01-22T05:24:59.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e356c59e-c00f-4bb3-8ee1-ce1528306df5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101312025-01-22T05:25:00.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4fd23966-4613-4d28-b913-c019663fb80d roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101322025-01-22T05:25:00.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4fd23966-4613-4d28-b913-c019663fb80d resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101332025-01-22T05:25:00.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4fd23966-4613-4d28-b913-c019663fb80d response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101342025-01-22T05:25:01.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6db4567b-ce44-4b76-8e33-d1d5ada4ca43 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101352025-01-22T05:25:01.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6db4567b-ce44-4b76-8e33-d1d5ada4ca43 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101362025-01-22T05:25:01.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6db4567b-ce44-4b76-8e33-d1d5ada4ca43 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101372025-01-22T05:25:02.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5cbc801-2a19-4730-9b8d-025b3653d4ab roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101382025-01-22T05:25:02.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5cbc801-2a19-4730-9b8d-025b3653d4ab resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101392025-01-22T05:25:02.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e5cbc801-2a19-4730-9b8d-025b3653d4ab response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
101402025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
101412025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101422025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
101432025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 30 reason = Timeout
101442025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
101452025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101462025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
101472025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101482025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
101492025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101502025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101512025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
101522025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101532025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
101542025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
101552025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101562025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101572025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
101582025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101592025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101602025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101612025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101622025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101632025-01-22T05:25:02.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101642025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101652025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101662025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101672025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101682025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
101692025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
101702025-01-22T05:25:02.826ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101712025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
101722025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101732025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101742025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101752025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
101762025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101772025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101782025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101792025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101802025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101812025-01-22T05:25:02.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101822025-01-22T05:25:02.828ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101832025-01-22T05:25:02.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101842025-01-22T05:25:02.829ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.862848ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101852025-01-22T05:25:02.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11685, tv_nsec: 175564951 } })
101862025-01-22T05:25:02.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
101872025-01-22T05:25:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
101882025-01-22T05:25:02.831ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101892025-01-22T05:25:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101902025-01-22T05:25:02.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101912025-01-22T05:25:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101922025-01-22T05:25:02.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101932025-01-22T05:25:02.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101942025-01-22T05:25:02.833ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11685, tv_nsec: 179315268 } })
101952025-01-22T05:25:02.833ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
101962025-01-22T05:25:02.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101972025-01-22T05:25:02.834ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101982025-01-22T05:25:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101992025-01-22T05:25:02.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102002025-01-22T05:25:02.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102012025-01-22T05:25:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102022025-01-22T05:25:02.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102032025-01-22T05:25:02.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102042025-01-22T05:25:02.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102052025-01-22T05:25:02.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102062025-01-22T05:25:02.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102072025-01-22T05:25:02.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102082025-01-22T05:25:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102092025-01-22T05:25:02.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102102025-01-22T05:25:02.842ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11685, tv_nsec: 187681038 } })
102112025-01-22T05:25:02.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102122025-01-22T05:25:02.842ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
102132025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
102142025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102152025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
102162025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
102172025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
102182025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102192025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
102202025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
102212025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102222025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102232025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102242025-01-22T05:25:02.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102252025-01-22T05:25:02.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102262025-01-22T05:25:02.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102272025-01-22T05:25:02.871ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102282025-01-22T05:25:02.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102292025-01-22T05:25:02.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102302025-01-22T05:25:02.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102312025-01-22T05:25:02.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102322025-01-22T05:25:02.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102332025-01-22T05:25:02.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102342025-01-22T05:25:02.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102352025-01-22T05:25:02.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102362025-01-22T05:25:02.872ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102372025-01-22T05:25:02.872ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102382025-01-22T05:25:02.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102392025-01-22T05:25:02.872ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102402025-01-22T05:25:02.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102412025-01-22T05:25:02.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102422025-01-22T05:25:02.873ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102432025-01-22T05:25:02.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102442025-01-22T05:25:02.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102452025-01-22T05:25:02.875ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102462025-01-22T05:25:02.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102472025-01-22T05:25:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102482025-01-22T05:25:02.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102492025-01-22T05:25:02.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102502025-01-22T05:25:02.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102512025-01-22T05:25:02.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.670593ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102522025-01-22T05:25:02.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
102532025-01-22T05:25:02.877ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102542025-01-22T05:25:02.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102552025-01-22T05:25:02.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102562025-01-22T05:25:02.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102572025-01-22T05:25:02.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102582025-01-22T05:25:02.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102592025-01-22T05:25:02.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102602025-01-22T05:25:02.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
102612025-01-22T05:25:02.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102622025-01-22T05:25:02.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102632025-01-22T05:25:02.881ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102642025-01-22T05:25:02.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102652025-01-22T05:25:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
102662025-01-22T05:25:02.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102672025-01-22T05:25:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102682025-01-22T05:25:02.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102692025-01-22T05:25:02.884ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.024772ms iteration = 30 status = 0
102702025-01-22T05:25:02.885ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102712025-01-22T05:25:02.885ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.246477ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102722025-01-22T05:25:02.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102732025-01-22T05:25:02.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102742025-01-22T05:25:02.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102752025-01-22T05:25:02.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.302342ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
102762025-01-22T05:25:02.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.537346ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
102772025-01-22T05:25:02.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102782025-01-22T05:25:02.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102792025-01-22T05:25:02.894ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
102802025-01-22T05:25:02.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.440585ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
102812025-01-22T05:25:02.909ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102822025-01-22T05:25:02.909ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102832025-01-22T05:25:02.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102842025-01-22T05:25:02.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102852025-01-22T05:25:02.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.010021ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102862025-01-22T05:25:02.914ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
102872025-01-22T05:25:02.914ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 89.009813ms iteration = 30 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
102882025-01-22T05:25:02.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102892025-01-22T05:25:02.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102902025-01-22T05:25:02.925ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
102912025-01-22T05:25:02.925ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102922025-01-22T05:25:02.925ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c228976-f457-4d39-91df-010f7cc8946d", "content-length": "26", "date": "Wed, 22 Jan 2025 05:25:02 GMT"} })
102932025-01-22T05:25:02.925ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102942025-01-22T05:25:02.927ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102952025-01-22T05:25:02.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
102962025-01-22T05:25:02.937ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102972025-01-22T05:25:02.938ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2fd4ac3-2697-4200-ae44-4882abcfa383", "content-length": "26", "date": "Wed, 22 Jan 2025 05:25:02 GMT"} })
102982025-01-22T05:25:02.938ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102992025-01-22T05:25:02.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
103002025-01-22T05:25:02.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103012025-01-22T05:25:02.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103022025-01-22T05:25:02.953ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
103032025-01-22T05:25:02.953ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103042025-01-22T05:25:02.953ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7143aca7-c288-42b3-ae48-ec167b508c11", "content-length": "26", "date": "Wed, 22 Jan 2025 05:25:02 GMT"} })
103052025-01-22T05:25:02.954ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103062025-01-22T05:25:02.955ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103072025-01-22T05:25:02.983ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.302345ms iteration = 33 status = {"physical_disks_added":0}
103082025-01-22T05:25:03.034ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103092025-01-22T05:25:03.034ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103102025-01-22T05:25:03.045ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5241842-fa04-4e3b-888a-4e4b9fae5a47", "content-length": "372", "date": "Wed, 22 Jan 2025 05:25:02 GMT"} })
103112025-01-22T05:25:03.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103122025-01-22T05:25:03.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103132025-01-22T05:25:03.051ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103142025-01-22T05:25:03.051ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d212f60-21af-440e-a043-6b5f6da3c137", "content-length": "2", "date": "Wed, 22 Jan 2025 05:25:02 GMT"} })
103152025-01-22T05:25:03.053ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103162025-01-22T05:25:03.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103172025-01-22T05:25:03.055ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 230.256441ms iteration = 30 status = null
103182025-01-22T05:25:03.063ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 238.07604ms iteration = 30 status = {}
103192025-01-22T05:25:03.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 218.944831ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
103202025-01-22T05:25:03.066ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103212025-01-22T05:25:03.066ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103222025-01-22T05:25:03.066ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 240.155922ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103232025-01-22T05:25:03.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 220.691626ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103242025-01-22T05:25:03.089ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
103252025-01-22T05:25:03.089ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103262025-01-22T05:25:03.090ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "10e2e909-c55d-42a6-93f9-a6f0ce16b509", "date": "Wed, 22 Jan 2025 05:25:03 GMT"} })
103272025-01-22T05:25:03.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103282025-01-22T05:25:03.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103292025-01-22T05:25:03.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103302025-01-22T05:25:03.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103312025-01-22T05:25:03.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103322025-01-22T05:25:03.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103332025-01-22T05:25:03.099ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103342025-01-22T05:25:03.099ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103352025-01-22T05:25:03.099ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c149766f-6ad4-43c6-a623-c5a5ece4d56c", "date": "Wed, 22 Jan 2025 05:25:03 GMT"} })
103362025-01-22T05:25:03.101ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 274.749937ms iteration = 31 status = {}
103372025-01-22T05:25:03.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103382025-01-22T05:25:03.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103392025-01-22T05:25:03.123ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
103402025-01-22T05:25:03.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103412025-01-22T05:25:03.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103422025-01-22T05:25:03.133ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103432025-01-22T05:25:03.133ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "809812f9-ada0-4a1a-a95e-75eaa6c7c45a", "content-length": "134", "date": "Wed, 22 Jan 2025 05:25:02 GMT"} })
103442025-01-22T05:25:03.133ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103452025-01-22T05:25:03.133ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
103462025-01-22T05:25:03.133ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103472025-01-22T05:25:03.133ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103482025-01-22T05:25:03.133ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103492025-01-22T05:25:03.133ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103502025-01-22T05:25:03.133ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103512025-01-22T05:25:03.133ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103522025-01-22T05:25:03.134ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103532025-01-22T05:25:03.134ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103542025-01-22T05:25:03.134ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
103552025-01-22T05:25:03.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103562025-01-22T05:25:03.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103572025-01-22T05:25:03.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103582025-01-22T05:25:03.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103592025-01-22T05:25:03.136ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103602025-01-22T05:25:03.136ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "80c4ab7d-c02c-4327-9ede-9312a3eda54c", "content-length": "2", "date": "Wed, 22 Jan 2025 05:25:02 GMT"} })
103612025-01-22T05:25:03.136ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103622025-01-22T05:25:03.136ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ee012cc-3831-41ad-9245-dd82ddcfd27b", "content-length": "51", "date": "Wed, 22 Jan 2025 05:25:02 GMT"} })
103632025-01-22T05:25:03.136ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
103642025-01-22T05:25:03.136ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103652025-01-22T05:25:03.164ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103662025-01-22T05:25:03.166ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103672025-01-22T05:25:03.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103682025-01-22T05:25:03.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103692025-01-22T05:25:03.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103702025-01-22T05:25:03.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103712025-01-22T05:25:03.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103722025-01-22T05:25:03.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103732025-01-22T05:25:03.238ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0a7b2906-efea-41c1-836e-c67517abc562", "date": "Wed, 22 Jan 2025 05:25:03 GMT"} })
103742025-01-22T05:25:03.238ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
103752025-01-22T05:25:03.238ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103762025-01-22T05:25:03.238ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "61eb86ce-7329-4d06-bdd7-e8e716c3bbb7", "content-length": "682", "date": "Wed, 22 Jan 2025 05:25:03 GMT"} })
103772025-01-22T05:25:03.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103782025-01-22T05:25:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103792025-01-22T05:25:03.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103802025-01-22T05:25:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103812025-01-22T05:25:03.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103822025-01-22T05:25:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103832025-01-22T05:25:03.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103842025-01-22T05:25:03.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103852025-01-22T05:25:03.255ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 430.08293ms iteration = 30 status = {}
103862025-01-22T05:25:03.289ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103872025-01-22T05:25:03.290ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e54155b8-5084-4244-94b2-762f6f924c0d", "content-length": "691", "date": "Wed, 22 Jan 2025 05:25:02 GMT"} })
103882025-01-22T05:25:03.290ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
103892025-01-22T05:25:03.290ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
103902025-01-22T05:25:03.290ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
103912025-01-22T05:25:03.292ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 467.008383ms iteration = 31 status = {}
103922025-01-22T05:25:03.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0de004fb-7aac-42cb-bb8f-1f6c3138dfe3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
103932025-01-22T05:25:03.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0de004fb-7aac-42cb-bb8f-1f6c3138dfe3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
103942025-01-22T05:25:03.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0de004fb-7aac-42cb-bb8f-1f6c3138dfe3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
103952025-01-22T05:25:04.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9ea1c229-c463-460a-9f3a-1be8255ab1f5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
103962025-01-22T05:25:04.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9ea1c229-c463-460a-9f3a-1be8255ab1f5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
103972025-01-22T05:25:04.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9ea1c229-c463-460a-9f3a-1be8255ab1f5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
103982025-01-22T05:25:05.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a4bc0136-e85d-46d3-99bf-89790ff233f5 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
103992025-01-22T05:25:05.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a4bc0136-e85d-46d3-99bf-89790ff233f5 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104002025-01-22T05:25:05.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a4bc0136-e85d-46d3-99bf-89790ff233f5 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104012025-01-22T05:25:05.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 624 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 2dbdb269-5a03-4e80-80e4-a8668d009096 response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
104022025-01-22T05:25:06.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9bb38e7f-0752-412d-bacc-5735d3eca2f9 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104032025-01-22T05:25:06.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9bb38e7f-0752-412d-bacc-5735d3eca2f9 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104042025-01-22T05:25:06.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 9bb38e7f-0752-412d-bacc-5735d3eca2f9 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104052025-01-22T05:25:07.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4bd8174a-77ae-430b-84cc-8da5de04214c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104062025-01-22T05:25:07.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4bd8174a-77ae-430b-84cc-8da5de04214c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104072025-01-22T05:25:07.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4bd8174a-77ae-430b-84cc-8da5de04214c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104082025-01-22T05:25:08.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e3af839d-df81-4d15-b1cb-273e39d23697 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104092025-01-22T05:25:08.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e3af839d-df81-4d15-b1cb-273e39d23697 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104102025-01-22T05:25:08.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e3af839d-df81-4d15-b1cb-273e39d23697 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104112025-01-22T05:25:09.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 674f73d5-5ae6-492a-bed6-98941303e648 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104122025-01-22T05:25:09.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 674f73d5-5ae6-492a-bed6-98941303e648 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104132025-01-22T05:25:09.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 674f73d5-5ae6-492a-bed6-98941303e648 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104142025-01-22T05:25:10.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5fec35fc-0ffe-4542-9308-6ce2b56f4b3e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104152025-01-22T05:25:10.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5fec35fc-0ffe-4542-9308-6ce2b56f4b3e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104162025-01-22T05:25:10.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 5fec35fc-0ffe-4542-9308-6ce2b56f4b3e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104172025-01-22T05:25:11.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ebe48847-602b-4546-8ddf-93e126ea78ac roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104182025-01-22T05:25:11.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ebe48847-602b-4546-8ddf-93e126ea78ac resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104192025-01-22T05:25:11.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ebe48847-602b-4546-8ddf-93e126ea78ac response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104202025-01-22T05:25:12.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8befd768-b325-4ef3-ba59-636be1cf897b roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104212025-01-22T05:25:12.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8befd768-b325-4ef3-ba59-636be1cf897b resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104222025-01-22T05:25:12.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8befd768-b325-4ef3-ba59-636be1cf897b response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104232025-01-22T05:25:12.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
104242025-01-22T05:25:12.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104252025-01-22T05:25:12.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104262025-01-22T05:25:12.826ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
104272025-01-22T05:25:12.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104282025-01-22T05:25:12.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104292025-01-22T05:25:12.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104302025-01-22T05:25:12.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104312025-01-22T05:25:12.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104322025-01-22T05:25:12.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104332025-01-22T05:25:12.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104342025-01-22T05:25:12.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104352025-01-22T05:25:12.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104362025-01-22T05:25:12.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104372025-01-22T05:25:12.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104382025-01-22T05:25:12.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
104392025-01-22T05:25:12.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104402025-01-22T05:25:12.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104412025-01-22T05:25:12.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
104422025-01-22T05:25:12.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.725174ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
104432025-01-22T05:25:12.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.712367ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104442025-01-22T05:25:13.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b5c3a6a5-e0b3-4bd7-b750-a8947894e1f1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104452025-01-22T05:25:13.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b5c3a6a5-e0b3-4bd7-b750-a8947894e1f1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104462025-01-22T05:25:13.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = b5c3a6a5-e0b3-4bd7-b750-a8947894e1f1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104472025-01-22T05:25:14.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0dfb34f6-49bd-41cd-8edd-f5a9188872e4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104482025-01-22T05:25:14.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0dfb34f6-49bd-41cd-8edd-f5a9188872e4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104492025-01-22T05:25:14.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 0dfb34f6-49bd-41cd-8edd-f5a9188872e4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104502025-01-22T05:25:15.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3841e649-eda9-4f20-8722-52fd1b7a183e roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104512025-01-22T05:25:15.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3841e649-eda9-4f20-8722-52fd1b7a183e resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104522025-01-22T05:25:15.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3841e649-eda9-4f20-8722-52fd1b7a183e response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104532025-01-22T05:25:15.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = e224abf7-025b-4c04-b141-c8b69f870aa1 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
104542025-01-22T05:25:15.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = e224abf7-025b-4c04-b141-c8b69f870aa1 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
104552025-01-22T05:25:15.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = e224abf7-025b-4c04-b141-c8b69f870aa1 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?sort_by=id_ascending
104562025-01-22T05:25:15.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = 17a5acfb-22ec-4a15-88cf-396da529aed8 roles = RoleSet { roles: {} } uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
104572025-01-22T05:25:15.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = 17a5acfb-22ec-4a15-88cf-396da529aed8 resource = Database result = Ok(()) uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
104582025-01-22T05:25:15.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51873 req_id = 17a5acfb-22ec-4a15-88cf-396da529aed8 response_code = 200 uri = /metrics/collectors/95fdbdf3-bbd5-4ea0-96d8-c5577faf4be0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlY2NmNGMzYi04MGVlLTRkN2EtOWQwZi04MzM2N2I3N2FiMTgifX0%3D
104592025-01-22T05:25:15.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 526 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 7d0c3786-51b2-4037-ac43-861236c3b32c response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
104602025-01-22T05:25:16.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f115c8f2-426e-431c-b9f8-0fd57a1849b0 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104612025-01-22T05:25:16.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f115c8f2-426e-431c-b9f8-0fd57a1849b0 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104622025-01-22T05:25:16.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = f115c8f2-426e-431c-b9f8-0fd57a1849b0 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104632025-01-22T05:25:17.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba2f6ace-1114-40a2-8b50-9ad5ab05e5f1 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104642025-01-22T05:25:17.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba2f6ace-1114-40a2-8b50-9ad5ab05e5f1 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104652025-01-22T05:25:17.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ba2f6ace-1114-40a2-8b50-9ad5ab05e5f1 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104662025-01-22T05:25:18.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 858827c4-f221-434b-a81c-db86adbc6355 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104672025-01-22T05:25:18.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 858827c4-f221-434b-a81c-db86adbc6355 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104682025-01-22T05:25:18.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 858827c4-f221-434b-a81c-db86adbc6355 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104692025-01-22T05:25:19.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 7abf5fa4-792c-4461-863d-0ba794a89f58 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
104702025-01-22T05:25:19.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 7abf5fa4-792c-4461-863d-0ba794a89f58 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
104712025-01-22T05:25:19.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:59627 req_id = 7abf5fa4-792c-4461-863d-0ba794a89f58 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
104722025-01-22T05:25:19.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 49748af4-adf7-43af-817e-a44537516f70 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104732025-01-22T05:25:19.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 49748af4-adf7-43af-817e-a44537516f70 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104742025-01-22T05:25:19.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 49748af4-adf7-43af-817e-a44537516f70 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104752025-01-22T05:25:20.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4c63b439-e463-4f32-9448-d382bf13f5ee roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104762025-01-22T05:25:20.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4c63b439-e463-4f32-9448-d382bf13f5ee resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104772025-01-22T05:25:20.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4c63b439-e463-4f32-9448-d382bf13f5ee response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104782025-01-22T05:25:21.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 15993771-0f80-4b86-99e6-ba7961e16075 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104792025-01-22T05:25:21.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 15993771-0f80-4b86-99e6-ba7961e16075 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104802025-01-22T05:25:21.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 15993771-0f80-4b86-99e6-ba7961e16075 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104812025-01-22T05:25:22.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a20b479-cfed-46e8-b86f-6a83cad57258 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104822025-01-22T05:25:22.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a20b479-cfed-46e8-b86f-6a83cad57258 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104832025-01-22T05:25:22.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 4a20b479-cfed-46e8-b86f-6a83cad57258 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
104842025-01-22T05:25:22.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
104852025-01-22T05:25:22.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104862025-01-22T05:25:22.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104872025-01-22T05:25:22.826ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
104882025-01-22T05:25:22.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104892025-01-22T05:25:22.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104902025-01-22T05:25:22.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104912025-01-22T05:25:22.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104922025-01-22T05:25:22.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104932025-01-22T05:25:22.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104942025-01-22T05:25:22.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104952025-01-22T05:25:22.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104962025-01-22T05:25:22.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104972025-01-22T05:25:22.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
104982025-01-22T05:25:22.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104992025-01-22T05:25:22.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105002025-01-22T05:25:22.847ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
105012025-01-22T05:25:22.847ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.264983ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
105022025-01-22T05:25:22.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105032025-01-22T05:25:22.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105042025-01-22T05:25:22.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.366081ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105052025-01-22T05:25:23.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3dd0b83f-4004-467f-81ec-09b8ca3190a3 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105062025-01-22T05:25:23.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3dd0b83f-4004-467f-81ec-09b8ca3190a3 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105072025-01-22T05:25:23.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 3dd0b83f-4004-467f-81ec-09b8ca3190a3 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105082025-01-22T05:25:24.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fd23dcff-6294-439e-82ac-fddebc376b72 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105092025-01-22T05:25:24.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fd23dcff-6294-439e-82ac-fddebc376b72 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105102025-01-22T05:25:24.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = fd23dcff-6294-439e-82ac-fddebc376b72 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105112025-01-22T05:25:25.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ffa138c0-0c38-468b-b9f5-c2022e3a584a roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105122025-01-22T05:25:25.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ffa138c0-0c38-468b-b9f5-c2022e3a584a resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105132025-01-22T05:25:25.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ffa138c0-0c38-468b-b9f5-c2022e3a584a response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105142025-01-22T05:25:25.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 910 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = b30c952b-b53c-4fbe-b5d4-8fb13e26909d response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
105152025-01-22T05:25:26.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 172dde66-6e04-4a1c-9ca8-6adc8710bb99 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105162025-01-22T05:25:26.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 172dde66-6e04-4a1c-9ca8-6adc8710bb99 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105172025-01-22T05:25:26.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 172dde66-6e04-4a1c-9ca8-6adc8710bb99 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105182025-01-22T05:25:27.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8a4b4d1c-9d0a-4688-9d6c-71c8653fee16 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105192025-01-22T05:25:27.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8a4b4d1c-9d0a-4688-9d6c-71c8653fee16 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105202025-01-22T05:25:27.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 8a4b4d1c-9d0a-4688-9d6c-71c8653fee16 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105212025-01-22T05:25:28.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d435ba45-2881-49d7-b18a-fd8e7ccf3c22 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105222025-01-22T05:25:28.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d435ba45-2881-49d7-b18a-fd8e7ccf3c22 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105232025-01-22T05:25:28.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d435ba45-2881-49d7-b18a-fd8e7ccf3c22 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105242025-01-22T05:25:29.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 34d7883c-4397-43c5-a276-aca05656a6ef roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105252025-01-22T05:25:29.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 34d7883c-4397-43c5-a276-aca05656a6ef resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105262025-01-22T05:25:29.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 34d7883c-4397-43c5-a276-aca05656a6ef response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105272025-01-22T05:25:30.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a25fcb3b-d5ed-4ca3-9ddd-0a7c2d246771 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105282025-01-22T05:25:30.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a25fcb3b-d5ed-4ca3-9ddd-0a7c2d246771 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105292025-01-22T05:25:30.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = a25fcb3b-d5ed-4ca3-9ddd-0a7c2d246771 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105302025-01-22T05:25:31.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cb0d914f-7add-4600-ad11-2d875b1755a8 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105312025-01-22T05:25:31.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cb0d914f-7add-4600-ad11-2d875b1755a8 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105322025-01-22T05:25:31.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = cb0d914f-7add-4600-ad11-2d875b1755a8 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
105332025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
105342025-01-22T05:25:32.825ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
105352025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
105362025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105372025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105382025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
105392025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
105402025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
105412025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
105422025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
105432025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105442025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105452025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
105462025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105472025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105482025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
105492025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
105502025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
105512025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105522025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
105532025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105542025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105552025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
105562025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
105572025-01-22T05:25:32.825ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-22 05:15:32.825820840 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
105582025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
105592025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
105602025-01-22T05:25:32.825ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede
105612025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.921\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede"}
105622025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 7 reason = Timeout
105632025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
105642025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
105652025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
105662025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
105672025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105682025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
105692025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105702025-01-22T05:25:32.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105712025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
105722025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
105732025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105742025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
105752025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 31 reason = Timeout
105762025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
105772025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
105782025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
105792025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
105802025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
105812025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105822025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105832025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
105842025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105852025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105862025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
105872025-01-22T05:25:32.826ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105882025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
105892025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105902025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105912025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
105922025-01-22T05:25:32.826ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
105932025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105942025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105952025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105962025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105972025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105982025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105992025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106002025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
106012025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106022025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106032025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
106042025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
106052025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106062025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106072025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106082025-01-22T05:25:32.826ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("358028b5-56dd-4575-bbf5-bf3b9b03d80f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c7d22dc6-a1ac-4ae2-9658-16be14c1294a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 11715, tv_nsec: 171901406 } })
106092025-01-22T05:25:32.826ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7cd07b16-262b-4033-b43d-7fa99b6945e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be98f96c-a0f0-4a3a-bb0a-bbbd928dbf3f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c23cd3c1-208e-47d6-868f-dd7ba02b4a5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 11715, tv_nsec: 171894406 } })
106102025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106112025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106122025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106132025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106142025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106152025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106162025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106172025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106182025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106192025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106202025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106212025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
106222025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106232025-01-22T05:25:32.826ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106242025-01-22T05:25:32.827ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
106252025-01-22T05:25:32.827ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.281826ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
106262025-01-22T05:25:32.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106272025-01-22T05:25:32.827ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106282025-01-22T05:25:32.827ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
106292025-01-22T05:25:32.827ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.307996ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
106302025-01-22T05:25:32.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106312025-01-22T05:25:32.828ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106322025-01-22T05:25:32.829ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106332025-01-22T05:25:32.830ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.495441ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106342025-01-22T05:25:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
106352025-01-22T05:25:32.831ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
106362025-01-22T05:25:32.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106372025-01-22T05:25:32.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
106382025-01-22T05:25:32.832ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106392025-01-22T05:25:32.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106402025-01-22T05:25:32.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11715, tv_nsec: 179572693 } })
106412025-01-22T05:25:32.834ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
106422025-01-22T05:25:32.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11715, tv_nsec: 179965831 } })
106432025-01-22T05:25:32.834ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
106442025-01-22T05:25:32.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106452025-01-22T05:25:32.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106462025-01-22T05:25:32.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106472025-01-22T05:25:32.835ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-22 05:15:32.825820840 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
106482025-01-22T05:25:32.835ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.921342ms iteration = 16 status = {"expiration":"2025-01-22T05:15:32.825820840Z","pruned":[]}
106492025-01-22T05:25:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106502025-01-22T05:25:32.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106512025-01-22T05:25:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106522025-01-22T05:25:32.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106532025-01-22T05:25:32.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106542025-01-22T05:25:32.843ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106552025-01-22T05:25:32.843ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106562025-01-22T05:25:32.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106572025-01-22T05:25:32.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106582025-01-22T05:25:32.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106592025-01-22T05:25:32.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106602025-01-22T05:25:32.846ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106612025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
106622025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
106632025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
106642025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
106652025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
106662025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106672025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
106682025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106692025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
106702025-01-22T05:25:32.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
106712025-01-22T05:25:32.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
106722025-01-22T05:25:32.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
106732025-01-22T05:25:32.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106742025-01-22T05:25:32.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
106752025-01-22T05:25:32.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106762025-01-22T05:25:32.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
106772025-01-22T05:25:32.850ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106782025-01-22T05:25:32.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106792025-01-22T05:25:32.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106802025-01-22T05:25:32.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106812025-01-22T05:25:32.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106822025-01-22T05:25:32.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106832025-01-22T05:25:32.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106842025-01-22T05:25:32.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106852025-01-22T05:25:32.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106862025-01-22T05:25:32.885ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106872025-01-22T05:25:32.885ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106882025-01-22T05:25:32.885ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106892025-01-22T05:25:32.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106902025-01-22T05:25:32.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106912025-01-22T05:25:32.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106922025-01-22T05:25:32.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106932025-01-22T05:25:32.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106942025-01-22T05:25:32.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
106952025-01-22T05:25:32.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106962025-01-22T05:25:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106972025-01-22T05:25:32.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106982025-01-22T05:25:32.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106992025-01-22T05:25:32.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107002025-01-22T05:25:32.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107012025-01-22T05:25:32.890ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107022025-01-22T05:25:32.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107032025-01-22T05:25:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107042025-01-22T05:25:32.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107052025-01-22T05:25:32.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
107062025-01-22T05:25:32.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107072025-01-22T05:25:32.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107082025-01-22T05:25:32.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107092025-01-22T05:25:32.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107102025-01-22T05:25:32.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107112025-01-22T05:25:32.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
107122025-01-22T05:25:32.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107132025-01-22T05:25:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107142025-01-22T05:25:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
107152025-01-22T05:25:32.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
107162025-01-22T05:25:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
107172025-01-22T05:25:32.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107182025-01-22T05:25:32.895ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 48.160061ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
107192025-01-22T05:25:32.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107202025-01-22T05:25:32.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107212025-01-22T05:25:32.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107222025-01-22T05:25:32.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107232025-01-22T05:25:32.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107242025-01-22T05:25:32.900ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
107252025-01-22T05:25:32.900ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
107262025-01-22T05:25:32.900ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.013308ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
107272025-01-22T05:25:32.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107282025-01-22T05:25:32.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
107292025-01-22T05:25:32.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107302025-01-22T05:25:32.901ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
107312025-01-22T05:25:32.901ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
107322025-01-22T05:25:32.901ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.699002ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
107332025-01-22T05:25:32.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107342025-01-22T05:25:32.902ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107352025-01-22T05:25:32.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107362025-01-22T05:25:32.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107372025-01-22T05:25:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107382025-01-22T05:25:32.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107392025-01-22T05:25:32.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
107402025-01-22T05:25:32.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107412025-01-22T05:25:32.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107422025-01-22T05:25:32.905ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107432025-01-22T05:25:32.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107442025-01-22T05:25:32.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107452025-01-22T05:25:32.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107462025-01-22T05:25:32.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
107472025-01-22T05:25:32.906ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107482025-01-22T05:25:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107492025-01-22T05:25:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
107502025-01-22T05:25:32.907ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
107512025-01-22T05:25:32.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
107522025-01-22T05:25:32.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107532025-01-22T05:25:32.910ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
107542025-01-22T05:25:32.910ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
107552025-01-22T05:25:32.910ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
107562025-01-22T05:25:32.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107572025-01-22T05:25:32.911ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-af8308ab-46c4-4104-b864-f43b03f195e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 11715, tv_nsec: 256609392 } })
107582025-01-22T05:25:32.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107592025-01-22T05:25:32.911ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
107602025-01-22T05:25:32.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107612025-01-22T05:25:32.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107622025-01-22T05:25:32.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107632025-01-22T05:25:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107642025-01-22T05:25:32.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107652025-01-22T05:25:32.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
107662025-01-22T05:25:32.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
107672025-01-22T05:25:32.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.512263ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107682025-01-22T05:25:32.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107692025-01-22T05:25:32.921ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107702025-01-22T05:25:32.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.248561ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107712025-01-22T05:25:32.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107722025-01-22T05:25:32.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107732025-01-22T05:25:32.923ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 97.800262ms iteration = 7 status = {"nsuccess":5}
107742025-01-22T05:25:32.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107752025-01-22T05:25:32.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107762025-01-22T05:25:32.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107772025-01-22T05:25:32.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107782025-01-22T05:25:32.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 248d9f35-5c61-4264-a8bb-b7f022f64ede, lookup_type: ById(248d9f35-5c61-4264-a8bb-b7f022f64ede) } result = Ok(())
107792025-01-22T05:25:32.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107802025-01-22T05:25:32.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107812025-01-22T05:25:32.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107822025-01-22T05:25:32.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107832025-01-22T05:25:32.944ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
107842025-01-22T05:25:32.944ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
107852025-01-22T05:25:32.944ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
107862025-01-22T05:25:32.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107872025-01-22T05:25:32.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107882025-01-22T05:25:32.946ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
107892025-01-22T05:25:32.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107902025-01-22T05:25:32.953ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107912025-01-22T05:25:32.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107922025-01-22T05:25:32.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
107932025-01-22T05:25:32.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107942025-01-22T05:25:32.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107952025-01-22T05:25:32.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.334555ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107962025-01-22T05:25:32.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 107.564771ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
107972025-01-22T05:25:32.955ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107982025-01-22T05:25:32.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107992025-01-22T05:25:32.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 109.153914ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
108002025-01-22T05:25:32.957ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108012025-01-22T05:25:32.958ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede original_time_created = 2025-01-22 05:10:23.123410 UTC target_id = 248d9f35-5c61-4264-a8bb-b7f022f64ede time_created = 2025-01-22 05:10:23.123410 UTC
108022025-01-22T05:25:32.958ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 132.413417ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"248d9f35-5c61-4264-a8bb-b7f022f64ede","time_created":"2025-01-22T05:10:23.123410Z"}
108032025-01-22T05:25:32.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108042025-01-22T05:25:32.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108052025-01-22T05:25:32.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108062025-01-22T05:25:32.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108072025-01-22T05:25:32.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108082025-01-22T05:25:32.960ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108092025-01-22T05:25:32.960ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
108102025-01-22T05:25:32.960ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.374537ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
108112025-01-22T05:25:32.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108122025-01-22T05:25:32.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
108132025-01-22T05:25:32.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108142025-01-22T05:25:32.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108152025-01-22T05:25:32.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
108162025-01-22T05:25:32.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108172025-01-22T05:25:32.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108182025-01-22T05:25:32.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108192025-01-22T05:25:32.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108202025-01-22T05:25:32.965ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
108212025-01-22T05:25:32.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108222025-01-22T05:25:32.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108232025-01-22T05:25:32.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108242025-01-22T05:25:32.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108252025-01-22T05:25:32.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
108262025-01-22T05:25:32.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
108272025-01-22T05:25:32.968ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108282025-01-22T05:25:32.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108292025-01-22T05:25:32.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108302025-01-22T05:25:32.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108312025-01-22T05:25:32.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108322025-01-22T05:25:32.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
108332025-01-22T05:25:32.970ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
108342025-01-22T05:25:32.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108352025-01-22T05:25:32.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108362025-01-22T05:25:32.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108372025-01-22T05:25:32.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108382025-01-22T05:25:32.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108392025-01-22T05:25:32.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108402025-01-22T05:25:32.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
108412025-01-22T05:25:32.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
108422025-01-22T05:25:32.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
108432025-01-22T05:25:32.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
108442025-01-22T05:25:32.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108452025-01-22T05:25:32.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108462025-01-22T05:25:32.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108472025-01-22T05:25:32.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108482025-01-22T05:25:32.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108492025-01-22T05:25:32.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
108502025-01-22T05:25:32.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108512025-01-22T05:25:32.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108522025-01-22T05:25:32.978ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 152.870964ms iteration = 31 status = 0
108532025-01-22T05:25:32.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108542025-01-22T05:25:32.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108552025-01-22T05:25:32.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108562025-01-22T05:25:32.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
108572025-01-22T05:25:32.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
108582025-01-22T05:25:32.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
108592025-01-22T05:25:32.981ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
108602025-01-22T05:25:32.981ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108612025-01-22T05:25:32.981ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69217883-072b-4b10-85e4-3f3198e027de", "content-length": "26", "date": "Wed, 22 Jan 2025 05:25:32 GMT"} })
108622025-01-22T05:25:32.981ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108632025-01-22T05:25:32.983ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108642025-01-22T05:25:32.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108652025-01-22T05:25:32.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108662025-01-22T05:25:32.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108672025-01-22T05:25:32.985ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108682025-01-22T05:25:32.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108692025-01-22T05:25:32.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 161.373647ms iteration = 7 status = {}
108702025-01-22T05:25:32.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108712025-01-22T05:25:32.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108722025-01-22T05:25:32.990ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108732025-01-22T05:25:32.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108742025-01-22T05:25:32.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108752025-01-22T05:25:32.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108762025-01-22T05:25:32.995ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 148.077996ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
108772025-01-22T05:25:32.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
108782025-01-22T05:25:33.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108792025-01-22T05:25:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108802025-01-22T05:25:33.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108812025-01-22T05:25:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108822025-01-22T05:25:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 168.129075ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
108832025-01-22T05:25:33.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108842025-01-22T05:25:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108852025-01-22T05:25:33.017ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
108862025-01-22T05:25:33.017ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 0 version = 2
108872025-01-22T05:25:33.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108882025-01-22T05:25:33.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108892025-01-22T05:25:33.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108902025-01-22T05:25:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108912025-01-22T05:25:33.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108922025-01-22T05:25:33.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108932025-01-22T05:25:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108942025-01-22T05:25:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108952025-01-22T05:25:33.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108962025-01-22T05:25:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108972025-01-22T05:25:33.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108982025-01-22T05:25:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108992025-01-22T05:25:33.025ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 29b25e9a-b684-4ffd-b9b7-56f2b25581f9 dns_zone_name = oxide.test found_so_far = 1 version = 2
109002025-01-22T05:25:33.025ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
109012025-01-22T05:25:33.025ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-22 05:11:24.845762 UTC dns_group = external generation = 2
109022025-01-22T05:25:33.025ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 199.433102ms iteration = 16 status = {"generation":2}
109032025-01-22T05:25:33.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109042025-01-22T05:25:33.025ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
109052025-01-22T05:25:33.025ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 200.028895ms iteration = 31 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
109062025-01-22T05:25:33.027ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
109072025-01-22T05:25:33.027ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109082025-01-22T05:25:33.027ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
109092025-01-22T05:25:33.027ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
109102025-01-22T05:25:33.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109112025-01-22T05:25:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109122025-01-22T05:25:33.027ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc1764c1-c4a2-4181-93f8-4f5a0358286b", "content-length": "26", "date": "Wed, 22 Jan 2025 05:25:32 GMT"} })
109132025-01-22T05:25:33.027ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109142025-01-22T05:25:33.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109152025-01-22T05:25:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109162025-01-22T05:25:33.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109172025-01-22T05:25:33.029ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109182025-01-22T05:25:33.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109192025-01-22T05:25:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109202025-01-22T05:25:33.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109212025-01-22T05:25:33.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109222025-01-22T05:25:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109232025-01-22T05:25:33.033ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109242025-01-22T05:25:33.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109252025-01-22T05:25:33.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109262025-01-22T05:25:33.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
109272025-01-22T05:25:33.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109282025-01-22T05:25:33.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109292025-01-22T05:25:33.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109302025-01-22T05:25:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109312025-01-22T05:25:33.035ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
109322025-01-22T05:25:33.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109332025-01-22T05:25:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109342025-01-22T05:25:33.036ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2d49d1e2-4a57-4ea1-bb32-4eb271d504bb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
109352025-01-22T05:25:33.036ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
109362025-01-22T05:25:33.036ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-22 05:11:24.033048 UTC dns_group = internal generation = 1
109372025-01-22T05:25:33.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 210.61334ms iteration = 16 status = {"generation":1}
109382025-01-22T05:25:33.063ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f zone_address = fd00:1122:3344:101::2
109392025-01-22T05:25:33.063ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109402025-01-22T05:25:33.064ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b026a375-e6c2-4bd1-ab3b-87f4bd10323b", "content-length": "26", "date": "Wed, 22 Jan 2025 05:25:32 GMT"} })
109412025-01-22T05:25:33.064ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109422025-01-22T05:25:33.065ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 239.326326ms iteration = 34 status = {"physical_disks_added":0}
109432025-01-22T05:25:33.066ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
109442025-01-22T05:25:33.078ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
109452025-01-22T05:25:33.078ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 252.436642ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
109462025-01-22T05:25:33.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ce6af6c6-d7b2-48bd-bc62-09fd913fa8e2 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
109472025-01-22T05:25:33.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ce6af6c6-d7b2-48bd-bc62-09fd913fa8e2 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
109482025-01-22T05:25:33.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109492025-01-22T05:25:33.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109502025-01-22T05:25:33.133ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
109512025-01-22T05:25:33.161ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
109522025-01-22T05:25:33.162ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cc26e817-2334-46db-81eb-da1c3bb161a2", "date": "Wed, 22 Jan 2025 05:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109532025-01-22T05:25:33.162ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109542025-01-22T05:25:33.164ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6ecc8aee-8c30-48e8-8456-e930e076e2c3", "date": "Wed, 22 Jan 2025 05:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109552025-01-22T05:25:33.164ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109562025-01-22T05:25:33.165ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
109572025-01-22T05:25:33.165ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 339.964696ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
109582025-01-22T05:25:33.183ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
109592025-01-22T05:25:33.183ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109602025-01-22T05:25:33.184ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c867b1c4-ee56-47c9-8782-27782db98a28", "content-length": "372", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
109612025-01-22T05:25:33.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109622025-01-22T05:25:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109632025-01-22T05:25:33.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109642025-01-22T05:25:33.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109652025-01-22T05:25:33.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = ce6af6c6-d7b2-48bd-bc62-09fd913fa8e2 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
109662025-01-22T05:25:33.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109672025-01-22T05:25:33.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109682025-01-22T05:25:33.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109692025-01-22T05:25:33.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109702025-01-22T05:25:33.190ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109712025-01-22T05:25:33.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109722025-01-22T05:25:33.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109732025-01-22T05:25:33.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109742025-01-22T05:25:33.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109752025-01-22T05:25:33.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109762025-01-22T05:25:33.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109772025-01-22T05:25:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109782025-01-22T05:25:33.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109792025-01-22T05:25:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109802025-01-22T05:25:33.204ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109812025-01-22T05:25:33.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109822025-01-22T05:25:33.206ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
109832025-01-22T05:25:33.207ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "480969b0-7e3b-4fdc-8efd-1b471f1dc221", "content-length": "2", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
109842025-01-22T05:25:33.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109852025-01-22T05:25:33.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109862025-01-22T05:25:33.210ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 384.968842ms iteration = 31 status = null
109872025-01-22T05:25:33.217ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 391.546207ms iteration = 31 status = {}
109882025-01-22T05:25:33.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109892025-01-22T05:25:33.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109902025-01-22T05:25:33.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109912025-01-22T05:25:33.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109922025-01-22T05:25:33.226ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-22T05:10:30.231578Z, time_modified: 2025-01-22T05:10:30.231578Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 98f37959-e334-4e44-8a28-8cd3a4681175, db_silo: Silo { identity: SiloIdentity { id: 98f37959-e334-4e44-8a28-8cd3a4681175, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-22T05:11:24.792947Z, time_modified: 2025-01-22T05:11:24.792947Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533" }] }) }
109932025-01-22T05:25:33.226ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 400.729783ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]}},"default_endpoint":{"silo_id":"98f37959-e334-4e44-8a28-8cd3a4681175","tls_certs":["55b33d811e507d592f9dcbd13598ba490556b919ba197638a433d8873370b533"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
109942025-01-22T05:25:33.231ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
109952025-01-22T05:25:33.231ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109962025-01-22T05:25:33.231ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0fa8eed7-4207-429c-833a-2eb08f6d2a17", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
109972025-01-22T05:25:33.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109982025-01-22T05:25:33.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109992025-01-22T05:25:33.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110002025-01-22T05:25:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110012025-01-22T05:25:33.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110022025-01-22T05:25:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110032025-01-22T05:25:33.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110042025-01-22T05:25:33.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110052025-01-22T05:25:33.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110062025-01-22T05:25:33.241ZINFOnexus (BackgroundTasks): VPC route manager sled af8308ab-46c4-4104-b864-f43b03f195e3 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110072025-01-22T05:25:33.241ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110082025-01-22T05:25:33.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110092025-01-22T05:25:33.241ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4c087716-c16a-4556-bb67-679ad850a891", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
110102025-01-22T05:25:33.242ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
110112025-01-22T05:25:33.243ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 417.019715ms iteration = 32 status = {}
110122025-01-22T05:25:33.243ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b9a19ea5-8bee-48b1-8ee7-54f710b74c0f", "date": "Wed, 22 Jan 2025 05:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
110132025-01-22T05:25:33.243ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
110142025-01-22T05:25:33.244ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d67c8038-a058-4857-9df1-13e3b2a3d505", "date": "Wed, 22 Jan 2025 05:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
110152025-01-22T05:25:33.244ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
110162025-01-22T05:25:33.246ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a7cbd43b-5d5f-4768-a97c-e73d1e440ad1", "date": "Wed, 22 Jan 2025 05:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
110172025-01-22T05:25:33.246ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
110182025-01-22T05:25:33.249ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
110192025-01-22T05:25:33.249ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 423.532188ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
110202025-01-22T05:25:33.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110212025-01-22T05:25:33.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
110222025-01-22T05:25:33.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110232025-01-22T05:25:33.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110242025-01-22T05:25:33.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110252025-01-22T05:25:33.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110262025-01-22T05:25:33.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110272025-01-22T05:25:33.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110282025-01-22T05:25:33.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110292025-01-22T05:25:33.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
110302025-01-22T05:25:33.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110312025-01-22T05:25:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110322025-01-22T05:25:33.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110332025-01-22T05:25:33.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110342025-01-22T05:25:33.342ZDEBGnexus (BackgroundTasks): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110352025-01-22T05:25:33.342ZDEBGnexus (BackgroundTasks): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9625d8a4-1dc5-4d08-b49c-ecab9ed2d3c1", "content-length": "691", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
110362025-01-22T05:25:33.342ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
110372025-01-22T05:25:33.342ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
110382025-01-22T05:25:33.342ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
110392025-01-22T05:25:33.344ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 518.254437ms iteration = 32 status = {}
110402025-01-22T05:25:33.344ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 603573fe-43d9-432a-ad48-f1cdca1d4167, kind: Service { id: c7d22dc6-a1ac-4ae2-9658-16be14c1294a }, name: Name("external-dns-c7d22dc6-a1ac-4ae2-9658-16be14c1294a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 165])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9917397f-ffee-49ec-b869-d35b0b743c02, kind: Service { id: 358028b5-56dd-4575-bbf5-bf3b9b03d80f }, name: Name("external-dns-358028b5-56dd-4575-bbf5-bf3b9b03d80f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 38])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 9396e9bd-ba9d-48e4-a278-7b7b84c18361, kind: Service { id: 1921c966-20bc-43ec-90bc-8bb3cb3c388f }, name: Name("nexus-1921c966-20bc-43ec-90bc-8bb3cb3c388f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6d43724-d167-4d59-9642-c64ff9718927, kind: Service { id: 3fbe3917-aca1-4b36-8119-948b03a24746 }, name: Name("nexus-3fbe3917-aca1-4b36-8119-948b03a24746"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dfba0bbc-9240-4b6a-84cb-7ae51a2f8f8a, kind: Service { id: 5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a }, name: Name("nexus-5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
110412025-01-22T05:25:33.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110422025-01-22T05:25:33.344ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c6834ddf-37d1-43be-bde0-093232cd861d, rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0eecf2dd-8f15-4436-bcbf-bde4eeca4f39) } rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
110432025-01-22T05:25:33.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110442025-01-22T05:25:33.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110452025-01-22T05:25:33.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110462025-01-22T05:25:33.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110472025-01-22T05:25:33.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
110482025-01-22T05:25:33.347ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110492025-01-22T05:25:33.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110502025-01-22T05:25:33.349ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
110512025-01-22T05:25:33.349ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 603573fe-43d9-432a-ad48-f1cdca1d4167, kind: Service { id: c7d22dc6-a1ac-4ae2-9658-16be14c1294a }, name: Name("external-dns-c7d22dc6-a1ac-4ae2-9658-16be14c1294a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 165])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9917397f-ffee-49ec-b869-d35b0b743c02, kind: Service { id: 358028b5-56dd-4575-bbf5-bf3b9b03d80f }, name: Name("external-dns-358028b5-56dd-4575-bbf5-bf3b9b03d80f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 38])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 9396e9bd-ba9d-48e4-a278-7b7b84c18361, kind: Service { id: 1921c966-20bc-43ec-90bc-8bb3cb3c388f }, name: Name("nexus-1921c966-20bc-43ec-90bc-8bb3cb3c388f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 129])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6d43724-d167-4d59-9642-c64ff9718927, kind: Service { id: 3fbe3917-aca1-4b36-8119-948b03a24746 }, name: Name("nexus-3fbe3917-aca1-4b36-8119-948b03a24746"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dfba0bbc-9240-4b6a-84cb-7ae51a2f8f8a, kind: Service { id: 5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a }, name: Name("nexus-5a2801c2-1d5b-4dfb-8aa7-e6d52695c34a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 180])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
110522025-01-22T05:25:33.349ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
110532025-01-22T05:25:33.354ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
110542025-01-22T05:25:33.354ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "51a13f7a-a779-4d02-ad1c-9a514574c297", "content-length": "134", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
110552025-01-22T05:25:33.354ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
110562025-01-22T05:25:33.354ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0eecf2dd-8f15-4436-bcbf-bde4eeca4f39
110572025-01-22T05:25:33.355ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
110582025-01-22T05:25:33.355ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
110592025-01-22T05:25:33.355ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110602025-01-22T05:25:33.355ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110612025-01-22T05:25:33.355ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110622025-01-22T05:25:33.355ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110632025-01-22T05:25:33.355ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110642025-01-22T05:25:33.355ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110652025-01-22T05:25:33.355ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f
110662025-01-22T05:25:33.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110672025-01-22T05:25:33.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110682025-01-22T05:25:33.361ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
110692025-01-22T05:25:33.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "13cdb29e-1add-4aa6-b53c-c0c1bac7170c", "content-length": "2", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
110702025-01-22T05:25:33.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
110712025-01-22T05:25:33.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "21545a97-86fb-495a-bbdf-aa132e07ce98", "content-length": "51", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
110722025-01-22T05:25:33.362ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch_location = Switch0
110732025-01-22T05:25:33.362ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
110742025-01-22T05:25:33.399ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: af8308ab-46c4-4104-b864-f43b03f195e3, time_created: 2025-01-22T05:11:20.582572Z, time_modified: 2025-01-22T05:11:20.582572Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0e4dc783-930a-4ca0-a39e-bca9bfdc004f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
110752025-01-22T05:25:33.399ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
110762025-01-22T05:25:33.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110772025-01-22T05:25:33.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110782025-01-22T05:25:33.402ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110792025-01-22T05:25:33.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110802025-01-22T05:25:33.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110812025-01-22T05:25:33.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: af8308ab-46c4-4104-b864-f43b03f195e3, lookup_type: ById(af8308ab-46c4-4104-b864-f43b03f195e3) } result = Ok(())
110822025-01-22T05:25:33.436ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
110832025-01-22T05:25:33.449ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e24a32e0-93f6-445a-83be-8f33358e9b84", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
110842025-01-22T05:25:33.449ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f switch = Switch0
110852025-01-22T05:25:33.449ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110862025-01-22T05:25:33.449ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0e4dc783-930a-4ca0-a39e-bca9bfdc004f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "33947035-4957-4604-9a58-5340df815589", "content-length": "682", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
110872025-01-22T05:25:33.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110882025-01-22T05:25:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110892025-01-22T05:25:33.450ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = af8308ab-46c4-4104-b864-f43b03f195e3 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "1096e1f2-af39-40bf-8908-dc388d072d23", "date": "Wed, 22 Jan 2025 05:25:33 GMT"} })
110902025-01-22T05:25:33.451ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
110912025-01-22T05:25:33.451ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 625.103343ms
110922025-01-22T05:25:33.451ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 625.112914ms iteration = 4 status = {}
110932025-01-22T05:25:33.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110942025-01-22T05:25:33.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110952025-01-22T05:25:33.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110962025-01-22T05:25:33.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110972025-01-22T05:25:33.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110982025-01-22T05:25:33.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110992025-01-22T05:25:33.467ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 641.553268ms iteration = 31 status = {}
111002025-01-22T05:25:34.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e3a88dc4-24db-4bf6-99ac-c92751fcdb4c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111012025-01-22T05:25:34.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e3a88dc4-24db-4bf6-99ac-c92751fcdb4c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111022025-01-22T05:25:34.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = e3a88dc4-24db-4bf6-99ac-c92751fcdb4c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111032025-01-22T05:25:35.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d78c4ff4-22ca-4b53-97ed-f73e91a54902 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111042025-01-22T05:25:35.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d78c4ff4-22ca-4b53-97ed-f73e91a54902 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111052025-01-22T05:25:35.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = d78c4ff4-22ca-4b53-97ed-f73e91a54902 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111062025-01-22T05:25:35.984ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 850 local_addr = [fd00:1122:3344:101::c]:58690 method = GET remote_addr = [fd00:1122:3344:101::d]:48037 req_id = 3299e33c-477e-4c4e-a5f8-4df4756fca8d response_code = 200 uri = /3fbe3917-aca1-4b36-8119-948b03a24746
111072025-01-22T05:25:36.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a9ca7d0-6a7b-4cbe-80d3-67df3156c61c roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111082025-01-22T05:25:36.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a9ca7d0-6a7b-4cbe-80d3-67df3156c61c resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111092025-01-22T05:25:36.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 6a9ca7d0-6a7b-4cbe-80d3-67df3156c61c response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111102025-01-22T05:25:37.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7da31ef9-1bee-40eb-867a-b1ad3a3e1629 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111112025-01-22T05:25:37.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7da31ef9-1bee-40eb-867a-b1ad3a3e1629 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111122025-01-22T05:25:37.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = 7da31ef9-1bee-40eb-867a-b1ad3a3e1629 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111132025-01-22T05:25:38.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c2cc7b10-1d34-4cf1-ad3d-407c60aae6a4 roles = RoleSet { roles: {} } uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111142025-01-22T05:25:38.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c2cc7b10-1d34-4cf1-ad3d-407c60aae6a4 resource = Database result = Ok(()) uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3
111152025-01-22T05:25:38.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:53196 req_id = c2cc7b10-1d34-4cf1-ad3d-407c60aae6a4 response_code = 200 uri = /probes/af8308ab-46c4-4104-b864-f43b03f195e3