Max level shown:
12024-12-18T20:00:00.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = dd66fd71-2a79-4e3b-9ea8-e4e78aa6658f roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
22024-12-18T20:00:00.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = dd66fd71-2a79-4e3b-9ea8-e4e78aa6658f resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
32024-12-18T20:00:00.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = dd66fd71-2a79-4e3b-9ea8-e4e78aa6658f response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
42024-12-18T20:00:01.081ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45037
52024-12-18T20:00:01.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45037 req_id = 9b8cfcf6-99f1-4a40-9187-43bc6c7f91c6 roles = RoleSet { roles: {} } uri = /metrics/producers
62024-12-18T20:00:01.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45037 req_id = 9b8cfcf6-99f1-4a40-9187-43bc6c7f91c6 resource = Database result = Ok(()) uri = /metrics/producers
72024-12-18T20:00:01.091ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = 58ee29db-9185-4216-97e8-559d204ec1d2
82024-12-18T20:00:01.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10104 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45037 req_id = 9b8cfcf6-99f1-4a40-9187-43bc6c7f91c6 response_code = 201 uri = /metrics/producers
92024-12-18T20:00:01.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 279b2b7d-510b-4792-8360-2fd9b7fa8c90 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
102024-12-18T20:00:01.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 279b2b7d-510b-4792-8360-2fd9b7fa8c90 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
112024-12-18T20:00:01.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 279b2b7d-510b-4792-8360-2fd9b7fa8c90 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
122024-12-18T20:00:02.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5033345d-59d8-4bf9-b69d-d5cf29df3dd3 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
132024-12-18T20:00:02.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5033345d-59d8-4bf9-b69d-d5cf29df3dd3 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
142024-12-18T20:00:02.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5033345d-59d8-4bf9-b69d-d5cf29df3dd3 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
152024-12-18T20:00:03.596ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
162024-12-18T20:00:03.596ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
172024-12-18T20:00:03.596ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
182024-12-18T20:00:03.596ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
192024-12-18T20:00:03.596ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
202024-12-18T20:00:03.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
212024-12-18T20:00:03.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
232024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
242024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
252024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
262024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
272024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
282024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
292024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
302024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
312024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
322024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
332024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
342024-12-18T20:00:03.597ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
352024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
362024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
372024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
382024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
392024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
402024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
412024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
422024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
432024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
442024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
452024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
462024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
472024-12-18T20:00:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
482024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
492024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
502024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
512024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
522024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
532024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
542024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
552024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
562024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
572024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
582024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
592024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
602024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
612024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
622024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
632024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
642024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
652024-12-18T20:00:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
662024-12-18T20:00:03.599ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.101764ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
672024-12-18T20:00:03.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1678, tv_nsec: 887568786 } })
682024-12-18T20:00:03.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1678, tv_nsec: 887791771 } })
692024-12-18T20:00:03.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
702024-12-18T20:00:03.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
712024-12-18T20:00:03.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
722024-12-18T20:00:03.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
732024-12-18T20:00:03.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
742024-12-18T20:00:03.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
752024-12-18T20:00:03.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
762024-12-18T20:00:03.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
772024-12-18T20:00:03.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
782024-12-18T20:00:03.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
792024-12-18T20:00:03.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
802024-12-18T20:00:03.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.066347ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
812024-12-18T20:00:03.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
822024-12-18T20:00:03.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
832024-12-18T20:00:03.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
842024-12-18T20:00:03.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
852024-12-18T20:00:03.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
862024-12-18T20:00:03.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
872024-12-18T20:00:03.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
882024-12-18T20:00:03.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
892024-12-18T20:00:03.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
902024-12-18T20:00:03.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
912024-12-18T20:00:03.614ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1678, tv_nsec: 902106885 } })
922024-12-18T20:00:03.614ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
932024-12-18T20:00:03.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
942024-12-18T20:00:03.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
952024-12-18T20:00:03.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
962024-12-18T20:00:03.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
972024-12-18T20:00:03.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
982024-12-18T20:00:03.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
992024-12-18T20:00:03.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1002024-12-18T20:00:03.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1012024-12-18T20:00:03.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
1022024-12-18T20:00:03.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1032024-12-18T20:00:03.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1042024-12-18T20:00:03.665ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.543729ms iteration = 24 status = 0
1052024-12-18T20:00:03.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1062024-12-18T20:00:03.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1072024-12-18T20:00:03.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1082024-12-18T20:00:03.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1092024-12-18T20:00:03.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1102024-12-18T20:00:03.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1112024-12-18T20:00:03.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1122024-12-18T20:00:03.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1132024-12-18T20:00:03.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1142024-12-18T20:00:03.678ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1152024-12-18T20:00:03.681ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1162024-12-18T20:00:03.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1172024-12-18T20:00:03.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1182024-12-18T20:00:03.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1192024-12-18T20:00:03.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1202024-12-18T20:00:03.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
1212024-12-18T20:00:03.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1222024-12-18T20:00:03.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1232024-12-18T20:00:03.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1242024-12-18T20:00:03.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1252024-12-18T20:00:03.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 84.528438ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
1262024-12-18T20:00:03.683ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1272024-12-18T20:00:03.683ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1282024-12-18T20:00:03.683ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1292024-12-18T20:00:03.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1302024-12-18T20:00:03.684ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1312024-12-18T20:00:03.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1322024-12-18T20:00:03.684ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1332024-12-18T20:00:03.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1342024-12-18T20:00:03.685ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1352024-12-18T20:00:03.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1362024-12-18T20:00:03.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1372024-12-18T20:00:03.687ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1382024-12-18T20:00:03.687ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.322457ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1392024-12-18T20:00:03.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1402024-12-18T20:00:03.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1412024-12-18T20:00:03.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1422024-12-18T20:00:03.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1432024-12-18T20:00:03.692ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1442024-12-18T20:00:03.692ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "07efa049-704e-4a7c-946d-da3888acf715", "content-length": "26", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
1452024-12-18T20:00:03.692ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1462024-12-18T20:00:03.694ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1472024-12-18T20:00:03.695ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
1482024-12-18T20:00:03.695ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.332432ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
1492024-12-18T20:00:03.697ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1502024-12-18T20:00:03.697ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1512024-12-18T20:00:03.697ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2177fdfe-22de-446a-be3c-89b08fb92270", "content-length": "26", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
1522024-12-18T20:00:03.697ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1532024-12-18T20:00:03.700ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1542024-12-18T20:00:03.710ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 zone_address = fd00:1122:3344:101::2
1552024-12-18T20:00:03.710ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1562024-12-18T20:00:03.710ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e1ea8f5-ca36-4866-811f-fdd21a33b3cd", "content-length": "26", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
1572024-12-18T20:00:03.710ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1582024-12-18T20:00:03.712ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
1592024-12-18T20:00:03.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 139.653562ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1602024-12-18T20:00:03.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1612024-12-18T20:00:03.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1622024-12-18T20:00:03.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 146.857751ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1632024-12-18T20:00:03.745ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1642024-12-18T20:00:03.745ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1652024-12-18T20:00:03.745ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1662024-12-18T20:00:03.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1672024-12-18T20:00:03.750ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 152.554238ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1682024-12-18T20:00:03.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 193.334946ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1692024-12-18T20:00:03.793ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1702024-12-18T20:00:03.793ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1712024-12-18T20:00:03.793ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 195.311478ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1722024-12-18T20:00:03.849ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 252.072244ms iteration = 28 status = {"physical_disks_added":0}
1732024-12-18T20:00:03.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1742024-12-18T20:00:03.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1752024-12-18T20:00:03.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1762024-12-18T20:00:03.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1772024-12-18T20:00:03.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1782024-12-18T20:00:03.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1792024-12-18T20:00:03.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1802024-12-18T20:00:03.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1812024-12-18T20:00:03.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1822024-12-18T20:00:03.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1832024-12-18T20:00:03.859ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1842024-12-18T20:00:03.859ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1852024-12-18T20:00:03.863ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "12d29779-fa52-400c-a6f4-86b5894c47ac", "content-length": "372", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
1862024-12-18T20:00:03.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1872024-12-18T20:00:03.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1882024-12-18T20:00:03.923ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
1892024-12-18T20:00:03.923ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
1902024-12-18T20:00:03.924ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "977116dc-b0db-46d5-961c-f3709512206d", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
1912024-12-18T20:00:03.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1922024-12-18T20:00:03.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1932024-12-18T20:00:03.927ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1942024-12-18T20:00:03.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1952024-12-18T20:00:03.927ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2db7fc8-b274-4315-b3af-742b00474d35", "content-length": "1", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
1962024-12-18T20:00:03.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1972024-12-18T20:00:03.929ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1982024-12-18T20:00:03.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1992024-12-18T20:00:03.930ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.476319ms iteration = 24 status = {}
2002024-12-18T20:00:03.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2012024-12-18T20:00:03.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2022024-12-18T20:00:03.934ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 337.89732ms iteration = 24 status = null
2032024-12-18T20:00:03.955ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2042024-12-18T20:00:03.955ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e706e38b-bb07-4792-83c4-dc1e3787dc1d", "content-length": "691", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
2052024-12-18T20:00:03.955ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2062024-12-18T20:00:03.955ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2072024-12-18T20:00:03.955ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2082024-12-18T20:00:03.956ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 358.574525ms iteration = 24 status = {}
2092024-12-18T20:00:03.958ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2102024-12-18T20:00:03.958ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2112024-12-18T20:00:03.958ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fb9b5e0b-0fce-48cc-8acd-e66cbc15a788", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
2122024-12-18T20:00:03.960ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 362.790142ms iteration = 25 status = {}
2132024-12-18T20:00:03.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2142024-12-18T20:00:03.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2152024-12-18T20:00:03.981ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c592ee00-6719-4702-903e-a4aee00a8af1, rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(37c692d6-efbe-4d30-b3c8-683fe7cd5daa) } rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
2162024-12-18T20:00:03.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2172024-12-18T20:00:03.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2182024-12-18T20:00:03.988ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2192024-12-18T20:00:03.988ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bce4ebd-c01b-4e07-8df0-0d80e71e4d46", "content-length": "134", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
2202024-12-18T20:00:03.988ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2212024-12-18T20:00:03.988ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 37c692d6-efbe-4d30-b3c8-683fe7cd5daa
2222024-12-18T20:00:03.989ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2232024-12-18T20:00:03.989ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2242024-12-18T20:00:03.989ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2252024-12-18T20:00:03.989ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2262024-12-18T20:00:03.989ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2272024-12-18T20:00:03.989ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2282024-12-18T20:00:03.989ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2292024-12-18T20:00:03.989ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2302024-12-18T20:00:03.989ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
2312024-12-18T20:00:03.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2322024-12-18T20:00:03.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2332024-12-18T20:00:03.991ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2342024-12-18T20:00:03.991ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f0022cb-5083-44af-87e0-b04f8c4fd4c7", "content-length": "2", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
2352024-12-18T20:00:03.991ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2362024-12-18T20:00:03.991ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "feebae77-8736-4a8f-b8ae-43cd7b40a119", "content-length": "52", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
2372024-12-18T20:00:03.991ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
2382024-12-18T20:00:03.991ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2392024-12-18T20:00:04.081ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2da15e45-2b05-4aae-af88-104af01fd48f", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
2402024-12-18T20:00:04.081ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch = Switch0
2412024-12-18T20:00:04.081ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2422024-12-18T20:00:04.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a9de5534-0755-4110-a0e8-2ba869508536 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2432024-12-18T20:00:04.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a9de5534-0755-4110-a0e8-2ba869508536 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2442024-12-18T20:00:04.081ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f192e9af-38c8-44e9-8b1d-ff67a49bff00", "content-length": "682", "date": "Wed, 18 Dec 2024 20:00:03 GMT"} })
2452024-12-18T20:00:04.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2462024-12-18T20:00:04.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2472024-12-18T20:00:04.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a9de5534-0755-4110-a0e8-2ba869508536 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2482024-12-18T20:00:04.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2492024-12-18T20:00:04.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2502024-12-18T20:00:04.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2512024-12-18T20:00:04.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2522024-12-18T20:00:04.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2532024-12-18T20:00:04.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2542024-12-18T20:00:04.099ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.423393ms iteration = 24 status = {}
2552024-12-18T20:00:04.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1437 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = b8600db1-4216-48f2-9971-a85367e0217f response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
2562024-12-18T20:00:05.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1ee7324c-380a-46df-a727-0334e004729a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2572024-12-18T20:00:05.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1ee7324c-380a-46df-a727-0334e004729a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2582024-12-18T20:00:05.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1ee7324c-380a-46df-a727-0334e004729a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2592024-12-18T20:00:06.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 46162946-046a-477a-8b10-256eed211c67 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2602024-12-18T20:00:06.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 46162946-046a-477a-8b10-256eed211c67 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2612024-12-18T20:00:06.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 46162946-046a-477a-8b10-256eed211c67 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2622024-12-18T20:00:07.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 74e0708a-a8a2-4109-8178-cf5c869b0329 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2632024-12-18T20:00:07.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 74e0708a-a8a2-4109-8178-cf5c869b0329 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2642024-12-18T20:00:07.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 74e0708a-a8a2-4109-8178-cf5c869b0329 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2652024-12-18T20:00:08.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 19866603-473d-4b3f-812f-ba595c4878a5 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2662024-12-18T20:00:08.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 19866603-473d-4b3f-812f-ba595c4878a5 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2672024-12-18T20:00:08.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 19866603-473d-4b3f-812f-ba595c4878a5 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2682024-12-18T20:00:09.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 09ca9aa4-d866-4eae-80c3-c283d3665f59 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2692024-12-18T20:00:09.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 09ca9aa4-d866-4eae-80c3-c283d3665f59 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2702024-12-18T20:00:09.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 09ca9aa4-d866-4eae-80c3-c283d3665f59 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2712024-12-18T20:00:10.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 06a4ae99-035c-4391-8380-711fb43f7a0a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2722024-12-18T20:00:10.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 06a4ae99-035c-4391-8380-711fb43f7a0a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2732024-12-18T20:00:10.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 06a4ae99-035c-4391-8380-711fb43f7a0a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2742024-12-18T20:00:11.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 58978551-813d-4a11-818f-265c18f9c058 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2752024-12-18T20:00:11.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 58978551-813d-4a11-818f-265c18f9c058 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2762024-12-18T20:00:11.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 58978551-813d-4a11-818f-265c18f9c058 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2772024-12-18T20:00:12.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c1f0f067-b4ef-418c-88f6-161e476fe337 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2782024-12-18T20:00:12.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c1f0f067-b4ef-418c-88f6-161e476fe337 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2792024-12-18T20:00:12.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c1f0f067-b4ef-418c-88f6-161e476fe337 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2802024-12-18T20:00:13.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1ee72c90-e065-4efb-b899-dedc09d8217b roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2812024-12-18T20:00:13.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1ee72c90-e065-4efb-b899-dedc09d8217b resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2822024-12-18T20:00:13.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1ee72c90-e065-4efb-b899-dedc09d8217b response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
2832024-12-18T20:00:13.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
2842024-12-18T20:00:13.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2852024-12-18T20:00:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2862024-12-18T20:00:13.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
2872024-12-18T20:00:13.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2882024-12-18T20:00:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2892024-12-18T20:00:13.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2902024-12-18T20:00:13.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2912024-12-18T20:00:13.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2922024-12-18T20:00:13.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.303898ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2932024-12-18T20:00:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2942024-12-18T20:00:13.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2952024-12-18T20:00:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2962024-12-18T20:00:13.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2972024-12-18T20:00:13.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2982024-12-18T20:00:13.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2992024-12-18T20:00:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
3002024-12-18T20:00:13.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3012024-12-18T20:00:13.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3022024-12-18T20:00:13.614ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
3032024-12-18T20:00:13.615ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.792526ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
3042024-12-18T20:00:14.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bdb082e5-8d9e-4533-9e72-9e640ff20ff7 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3052024-12-18T20:00:14.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bdb082e5-8d9e-4533-9e72-9e640ff20ff7 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3062024-12-18T20:00:14.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bdb082e5-8d9e-4533-9e72-9e640ff20ff7 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3072024-12-18T20:00:14.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1279 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = aa964432-433f-41c0-a343-50091e688e1e response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
3082024-12-18T20:00:15.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b3619f87-acb3-4a4f-9a71-6ca9edf70563 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3092024-12-18T20:00:15.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b3619f87-acb3-4a4f-9a71-6ca9edf70563 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3102024-12-18T20:00:15.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b3619f87-acb3-4a4f-9a71-6ca9edf70563 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3112024-12-18T20:00:16.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a2ba766c-6e80-4404-b088-43980837d3ff roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3122024-12-18T20:00:16.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a2ba766c-6e80-4404-b088-43980837d3ff resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3132024-12-18T20:00:16.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a2ba766c-6e80-4404-b088-43980837d3ff response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3142024-12-18T20:00:17.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d5e9f40e-bf2d-4dea-9196-116ae5694ca8 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3152024-12-18T20:00:17.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d5e9f40e-bf2d-4dea-9196-116ae5694ca8 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3162024-12-18T20:00:17.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d5e9f40e-bf2d-4dea-9196-116ae5694ca8 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3172024-12-18T20:00:18.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7ac1655a-27f8-46ee-8626-f5dabdf134d5 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3182024-12-18T20:00:18.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7ac1655a-27f8-46ee-8626-f5dabdf134d5 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3192024-12-18T20:00:18.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7ac1655a-27f8-46ee-8626-f5dabdf134d5 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3202024-12-18T20:00:19.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f6649246-4ffd-4c7a-9a83-0e935511b804 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3212024-12-18T20:00:19.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f6649246-4ffd-4c7a-9a83-0e935511b804 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3222024-12-18T20:00:19.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f6649246-4ffd-4c7a-9a83-0e935511b804 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3232024-12-18T20:00:20.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 724a7653-b3a1-4c2d-80d2-cb84fc93abfa roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3242024-12-18T20:00:20.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 724a7653-b3a1-4c2d-80d2-cb84fc93abfa resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3252024-12-18T20:00:20.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 724a7653-b3a1-4c2d-80d2-cb84fc93abfa response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3262024-12-18T20:00:21.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a43d6d6e-8e31-41fa-9132-e031d986f06f roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3272024-12-18T20:00:21.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a43d6d6e-8e31-41fa-9132-e031d986f06f resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3282024-12-18T20:00:21.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a43d6d6e-8e31-41fa-9132-e031d986f06f response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3292024-12-18T20:00:22.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ff68782c-9bcb-4235-905c-7c96acf6bd17 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3302024-12-18T20:00:22.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ff68782c-9bcb-4235-905c-7c96acf6bd17 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3312024-12-18T20:00:22.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ff68782c-9bcb-4235-905c-7c96acf6bd17 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3322024-12-18T20:00:23.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 75998d06-e65f-498f-b4fd-dcff58abc5c3 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3332024-12-18T20:00:23.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 75998d06-e65f-498f-b4fd-dcff58abc5c3 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3342024-12-18T20:00:23.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 75998d06-e65f-498f-b4fd-dcff58abc5c3 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3352024-12-18T20:00:23.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
3362024-12-18T20:00:23.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3372024-12-18T20:00:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3382024-12-18T20:00:23.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
3392024-12-18T20:00:23.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3402024-12-18T20:00:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3412024-12-18T20:00:23.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422024-12-18T20:00:23.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3432024-12-18T20:00:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3442024-12-18T20:00:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3452024-12-18T20:00:23.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3462024-12-18T20:00:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3472024-12-18T20:00:23.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3482024-12-18T20:00:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3492024-12-18T20:00:23.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3502024-12-18T20:00:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
3512024-12-18T20:00:23.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3522024-12-18T20:00:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3532024-12-18T20:00:23.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
3542024-12-18T20:00:23.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.441492ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
3552024-12-18T20:00:23.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.998195ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3562024-12-18T20:00:24.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e17d4ff9-a750-48ba-8c06-6c79c121ae4e roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3572024-12-18T20:00:24.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e17d4ff9-a750-48ba-8c06-6c79c121ae4e resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3582024-12-18T20:00:24.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e17d4ff9-a750-48ba-8c06-6c79c121ae4e response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3592024-12-18T20:00:24.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1318 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 15ba483d-e392-4a13-b7c4-fd0510243b27 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
3602024-12-18T20:00:25.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5787865d-c0b1-4b07-8bb0-6c790cf80d7f roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3612024-12-18T20:00:25.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5787865d-c0b1-4b07-8bb0-6c790cf80d7f resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3622024-12-18T20:00:25.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5787865d-c0b1-4b07-8bb0-6c790cf80d7f response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3632024-12-18T20:00:26.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0691a449-e8b5-40bd-838a-a9abcc4fa1d2 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3642024-12-18T20:00:26.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0691a449-e8b5-40bd-838a-a9abcc4fa1d2 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3652024-12-18T20:00:26.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0691a449-e8b5-40bd-838a-a9abcc4fa1d2 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3662024-12-18T20:00:27.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = daf31dab-b7e0-48c6-8e94-d51265bb5f36 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3672024-12-18T20:00:27.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = daf31dab-b7e0-48c6-8e94-d51265bb5f36 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3682024-12-18T20:00:27.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = daf31dab-b7e0-48c6-8e94-d51265bb5f36 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3692024-12-18T20:00:28.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 176f5c0e-d050-4e79-b590-abe7aa58bcca roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3702024-12-18T20:00:28.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 176f5c0e-d050-4e79-b590-abe7aa58bcca resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3712024-12-18T20:00:28.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 176f5c0e-d050-4e79-b590-abe7aa58bcca response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3722024-12-18T20:00:29.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 6a7aa574-3a88-4d73-8504-728c1dd02724 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
3732024-12-18T20:00:29.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 6a7aa574-3a88-4d73-8504-728c1dd02724 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
3742024-12-18T20:00:29.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 6a7aa574-3a88-4d73-8504-728c1dd02724 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
3752024-12-18T20:00:29.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 51bc3d2c-9c9f-4f26-81b7-52a9560b406b roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
3762024-12-18T20:00:29.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 51bc3d2c-9c9f-4f26-81b7-52a9560b406b resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
3772024-12-18T20:00:29.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 51bc3d2c-9c9f-4f26-81b7-52a9560b406b response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
3782024-12-18T20:00:29.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 589eceb6-f396-4445-81b1-8bedbee9a89a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3792024-12-18T20:00:29.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 589eceb6-f396-4445-81b1-8bedbee9a89a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3802024-12-18T20:00:29.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 589eceb6-f396-4445-81b1-8bedbee9a89a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3812024-12-18T20:00:30.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = cd691f6e-ccfe-42cb-995d-af3ea6b6b121 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3822024-12-18T20:00:30.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = cd691f6e-ccfe-42cb-995d-af3ea6b6b121 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3832024-12-18T20:00:30.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = cd691f6e-ccfe-42cb-995d-af3ea6b6b121 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3842024-12-18T20:00:31.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 618400eb-9f43-45dc-a950-b7c2f9c17e21 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3852024-12-18T20:00:31.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 618400eb-9f43-45dc-a950-b7c2f9c17e21 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3862024-12-18T20:00:31.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 618400eb-9f43-45dc-a950-b7c2f9c17e21 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
3872024-12-18T20:00:32.305ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8facc43d-442d-4251-9d6c-1ed379674b34 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-18T20:00:32.295796917Z }
3882024-12-18T20:00:32.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8facc43d-442d-4251-9d6c-1ed379674b34 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
3892024-12-18T20:00:32.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8facc43d-442d-4251-9d6c-1ed379674b34 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
3902024-12-18T20:00:32.328ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:39630
3912024-12-18T20:00:32.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39630 req_id = f8f242c8-a7e1-416a-9dbf-2fb057d5329f roles = RoleSet { roles: {} } uri = /metrics/producers
3922024-12-18T20:00:32.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39630 req_id = f8f242c8-a7e1-416a-9dbf-2fb057d5329f resource = Database result = Ok(()) uri = /metrics/producers
3932024-12-18T20:00:32.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63909 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8facc43d-442d-4251-9d6c-1ed379674b34 response_code = 204 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
3942024-12-18T20:00:32.367ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d97677c5-7b5d-4ae9-9840-713980a661e2 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T20:00:32.367049483Z }
3952024-12-18T20:00:32.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d97677c5-7b5d-4ae9-9840-713980a661e2 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
3962024-12-18T20:00:32.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d97677c5-7b5d-4ae9-9840-713980a661e2 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
3972024-12-18T20:00:32.391ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5
3982024-12-18T20:00:32.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62315 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39630 req_id = f8f242c8-a7e1-416a-9dbf-2fb057d5329f response_code = 201 uri = /metrics/producers
3992024-12-18T20:00:32.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63156 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d97677c5-7b5d-4ae9-9840-713980a661e2 response_code = 204 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
4002024-12-18T20:00:32.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10a154e4-92e9-4350-ac8c-850703e9983d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
4012024-12-18T20:00:32.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10a154e4-92e9-4350-ac8c-850703e9983d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
4022024-12-18T20:00:32.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10a154e4-92e9-4350-ac8c-850703e9983d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
4032024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
4042024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
4052024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
4062024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
4072024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
4082024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4092024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
4102024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4112024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4122024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
4132024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4142024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4152024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
4162024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
4172024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4182024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
4192024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4202024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4212024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
4222024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
4232024-12-18T20:00:33.596ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 19:50:33.596651893 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4242024-12-18T20:00:33.596ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4252024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4262024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4272024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4282024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4292024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4302024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4312024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4322024-12-18T20:00:33.597ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e3d8b46-b399-4d3c-bc66-63409f4abd06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9da4e3ea-a57c-4b2b-81c3-7f374155d667.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9da4e3ea-a57c-4b2b-81c3-7f374155d667.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1708, tv_nsec: 884534686 } })
4332024-12-18T20:00:33.597ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73c17a86-f1fb-4102-92b8-0059f9ce4d77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89d5399b-5669-48fc-9549-d301f3010160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("967a5ab6-9437-47ac-b51c-7113605783e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("967a5ab6-9437-47ac-b51c-7113605783e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1708, tv_nsec: 884580647 } })
4342024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
4352024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4362024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
4372024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4382024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
4392024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
4402024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4412024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
4422024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4432024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4442024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
4452024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
4462024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
4472024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4482024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4492024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4502024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
4512024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4522024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
4532024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
4542024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4552024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
4562024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4572024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4582024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
4592024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4602024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
4612024-12-18T20:00:33.597ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66
4622024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.661\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66"}
4632024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
4642024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
4652024-12-18T20:00:33.597ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4662024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4672024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4682024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
4692024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4702024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4712024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
4722024-12-18T20:00:33.597ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4732024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4742024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
4752024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4762024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4772024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4782024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
4792024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4802024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.277157ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4812024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4822024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4832024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4842024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4852024-12-18T20:00:33.597ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
4862024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.508081ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4872024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4882024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4892024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4902024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4912024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4922024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4932024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4942024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4952024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4962024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4972024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4982024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4992024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5002024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5012024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5022024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5032024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5042024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5052024-12-18T20:00:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5062024-12-18T20:00:33.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5072024-12-18T20:00:33.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082024-12-18T20:00:33.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5092024-12-18T20:00:33.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5102024-12-18T20:00:33.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1708, tv_nsec: 888852535 } })
5112024-12-18T20:00:33.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5122024-12-18T20:00:33.602ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.394451ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5132024-12-18T20:00:33.602ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 19:50:33.596651893 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5142024-12-18T20:00:33.602ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.974333ms iteration = 13 status = {"expiration":"2024-12-18T19:50:33.596651893Z","pruned":[]}
5152024-12-18T20:00:33.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5162024-12-18T20:00:33.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5172024-12-18T20:00:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5182024-12-18T20:00:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5192024-12-18T20:00:33.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5202024-12-18T20:00:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5212024-12-18T20:00:33.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5222024-12-18T20:00:33.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5232024-12-18T20:00:33.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1708, tv_nsec: 893627983 } })
5242024-12-18T20:00:33.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5252024-12-18T20:00:33.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5262024-12-18T20:00:33.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5272024-12-18T20:00:33.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.684671ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
5282024-12-18T20:00:33.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5292024-12-18T20:00:33.610ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5302024-12-18T20:00:33.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5312024-12-18T20:00:33.611ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5322024-12-18T20:00:33.611ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5332024-12-18T20:00:33.611ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.245063ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5342024-12-18T20:00:33.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5352024-12-18T20:00:33.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5362024-12-18T20:00:33.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5372024-12-18T20:00:33.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5382024-12-18T20:00:33.615ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.316927ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
5392024-12-18T20:00:33.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5402024-12-18T20:00:33.616ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5412024-12-18T20:00:33.616ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5422024-12-18T20:00:33.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5432024-12-18T20:00:33.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5442024-12-18T20:00:33.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5452024-12-18T20:00:33.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5462024-12-18T20:00:33.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5472024-12-18T20:00:33.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5482024-12-18T20:00:33.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5492024-12-18T20:00:33.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5502024-12-18T20:00:33.621ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-12-18T20:00:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5522024-12-18T20:00:33.624ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5532024-12-18T20:00:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5542024-12-18T20:00:33.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5552024-12-18T20:00:33.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5562024-12-18T20:00:33.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5572024-12-18T20:00:33.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5582024-12-18T20:00:33.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5592024-12-18T20:00:33.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5602024-12-18T20:00:33.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-12-18T20:00:33.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5622024-12-18T20:00:33.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5632024-12-18T20:00:33.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5642024-12-18T20:00:33.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652024-12-18T20:00:33.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662024-12-18T20:00:33.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5672024-12-18T20:00:33.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5682024-12-18T20:00:33.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5692024-12-18T20:00:33.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5702024-12-18T20:00:33.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5712024-12-18T20:00:33.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5722024-12-18T20:00:33.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5732024-12-18T20:00:33.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5742024-12-18T20:00:33.643ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1708, tv_nsec: 930322408 } })
5752024-12-18T20:00:33.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5762024-12-18T20:00:33.643ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
5772024-12-18T20:00:33.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5782024-12-18T20:00:33.643ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5792024-12-18T20:00:33.643ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5802024-12-18T20:00:33.643ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5812024-12-18T20:00:33.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5822024-12-18T20:00:33.650ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5832024-12-18T20:00:33.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5842024-12-18T20:00:33.654ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5852024-12-18T20:00:33.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-12-18T20:00:33.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5872024-12-18T20:00:33.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
5882024-12-18T20:00:33.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5892024-12-18T20:00:33.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5902024-12-18T20:00:33.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5912024-12-18T20:00:33.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5922024-12-18T20:00:33.690ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5932024-12-18T20:00:33.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5942024-12-18T20:00:33.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.032976ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5952024-12-18T20:00:33.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.260401ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5962024-12-18T20:00:33.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5972024-12-18T20:00:33.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5982024-12-18T20:00:33.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5992024-12-18T20:00:33.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6002024-12-18T20:00:33.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 100.762053ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
6012024-12-18T20:00:33.704ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6022024-12-18T20:00:33.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6032024-12-18T20:00:33.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6042024-12-18T20:00:33.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6052024-12-18T20:00:33.707ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
6062024-12-18T20:00:33.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.295849ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
6072024-12-18T20:00:33.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6082024-12-18T20:00:33.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6092024-12-18T20:00:33.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6102024-12-18T20:00:33.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6112024-12-18T20:00:33.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6122024-12-18T20:00:33.713ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6132024-12-18T20:00:33.713ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6142024-12-18T20:00:33.713ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6152024-12-18T20:00:33.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6162024-12-18T20:00:33.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6172024-12-18T20:00:33.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6182024-12-18T20:00:33.715ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6192024-12-18T20:00:33.716ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6202024-12-18T20:00:33.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6212024-12-18T20:00:33.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6222024-12-18T20:00:33.719ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6232024-12-18T20:00:33.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6242024-12-18T20:00:33.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6252024-12-18T20:00:33.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6262024-12-18T20:00:33.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6272024-12-18T20:00:33.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6282024-12-18T20:00:33.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6292024-12-18T20:00:33.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6302024-12-18T20:00:33.724ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 126.660476ms iteration = 6 status = {"nsuccess":5}
6312024-12-18T20:00:33.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6322024-12-18T20:00:33.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6332024-12-18T20:00:33.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6342024-12-18T20:00:33.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6352024-12-18T20:00:33.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6362024-12-18T20:00:33.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6372024-12-18T20:00:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6382024-12-18T20:00:33.729ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6392024-12-18T20:00:33.729ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6402024-12-18T20:00:33.729ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 132.060426ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6412024-12-18T20:00:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6422024-12-18T20:00:33.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6432024-12-18T20:00:33.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6442024-12-18T20:00:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6452024-12-18T20:00:33.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6462024-12-18T20:00:33.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6472024-12-18T20:00:33.731ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6482024-12-18T20:00:33.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6492024-12-18T20:00:33.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6502024-12-18T20:00:33.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6512024-12-18T20:00:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6522024-12-18T20:00:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
6532024-12-18T20:00:33.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6542024-12-18T20:00:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6552024-12-18T20:00:33.736ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 139.02502ms iteration = 25 status = 0
6562024-12-18T20:00:33.753ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6572024-12-18T20:00:33.754ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6582024-12-18T20:00:33.754ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6592024-12-18T20:00:33.754ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.818986ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6602024-12-18T20:00:33.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 75ecb28d-2914-43ee-a14b-96b1f645e1ba roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
6612024-12-18T20:00:33.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 75ecb28d-2914-43ee-a14b-96b1f645e1ba resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
6622024-12-18T20:00:33.768ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6632024-12-18T20:00:33.768ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6642024-12-18T20:00:33.769ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3989b2b7-810a-4a25-af7d-63f0c33fd02b", "content-length": "26", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
6652024-12-18T20:00:33.769ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6662024-12-18T20:00:33.771ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6672024-12-18T20:00:33.778ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6682024-12-18T20:00:33.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6692024-12-18T20:00:33.781ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6702024-12-18T20:00:33.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6712024-12-18T20:00:33.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 186.411044ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6722024-12-18T20:00:33.793ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6732024-12-18T20:00:33.793ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6742024-12-18T20:00:33.793ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6752024-12-18T20:00:33.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6762024-12-18T20:00:33.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6772024-12-18T20:00:33.802ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6782024-12-18T20:00:33.802ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c5344268-eb33-4765-9d91-b9438861661e dns_zone_name = oxide.test found_so_far = 0 version = 2
6792024-12-18T20:00:33.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6802024-12-18T20:00:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6812024-12-18T20:00:33.831ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T19:48:29.764483Z, time_modified: 2024-12-18T19:48:29.764483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9066e168-08ec-47af-a018-fa1edb0a15cb, db_silo: Silo { identity: SiloIdentity { id: 9066e168-08ec-47af-a018-fa1edb0a15cb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T19:48:35.229287Z, time_modified: 2024-12-18T19:48:35.229287Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9066e168-08ec-47af-a018-fa1edb0a15cb, db_silo: Silo { identity: SiloIdentity { id: 9066e168-08ec-47af-a018-fa1edb0a15cb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T19:48:35.229287Z, time_modified: 2024-12-18T19:48:35.229287Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
6822024-12-18T20:00:33.831ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 234.821089ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9066e168-08ec-47af-a018-fa1edb0a15cb","tls_certs":["828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e"]}},"default_endpoint":{"silo_id":"9066e168-08ec-47af-a018-fa1edb0a15cb","tls_certs":["828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
6832024-12-18T20:00:33.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6842024-12-18T20:00:33.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6852024-12-18T20:00:33.871ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6862024-12-18T20:00:33.871ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6872024-12-18T20:00:33.871ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47cd6ae1-0dd2-4726-9a0c-1f151c68c45b", "content-length": "26", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
6882024-12-18T20:00:33.871ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6892024-12-18T20:00:33.873ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6902024-12-18T20:00:33.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 zone_address = fd00:1122:3344:101::2
6912024-12-18T20:00:33.921ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6922024-12-18T20:00:33.922ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b25f72f-a507-4344-9f96-8878ebdc8ae5", "content-length": "26", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
6932024-12-18T20:00:33.922ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6942024-12-18T20:00:33.924ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
6952024-12-18T20:00:33.950ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 352.856707ms iteration = 29 status = {"physical_disks_added":0}
6962024-12-18T20:00:33.951ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6972024-12-18T20:00:33.951ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "13f68b01-3709-45ce-8e94-7b89c1662905", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6982024-12-18T20:00:33.952ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6992024-12-18T20:00:33.954ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "eecc6693-557a-4b9f-b73b-23b27c50cbe9", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7002024-12-18T20:00:33.954ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7012024-12-18T20:00:33.955ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7022024-12-18T20:00:33.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 359.405203ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7032024-12-18T20:00:33.997ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7042024-12-18T20:00:34.085ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7052024-12-18T20:00:34.085ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7062024-12-18T20:00:34.085ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "54b3cd92-4383-4cec-a30c-df15439d3145", "content-length": "581", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
7072024-12-18T20:00:34.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7082024-12-18T20:00:34.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7092024-12-18T20:00:34.089ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/847fe597-97bb-407a-9591-7b5a43309652/state
7102024-12-18T20:00:34.091ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/847fe597-97bb-407a-9591-7b5a43309652/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "c50cc452-8434-483e-9341-4e626dc64582", "content-length": "130", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
7112024-12-18T20:00:34.091ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T20:00:32.367049483Z }, migration_in: None, migration_out: None } vmm_id = 847fe597-97bb-407a-9591-7b5a43309652
7122024-12-18T20:00:34.091ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 vmm_id = 847fe597-97bb-407a-9591-7b5a43309652 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T20:00:32.367049483Z }
7132024-12-18T20:00:34.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 roles = RoleSet { roles: {} } sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 vmm_id = 847fe597-97bb-407a-9591-7b5a43309652
7142024-12-18T20:00:34.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 resource = Database result = Ok(()) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 vmm_id = 847fe597-97bb-407a-9591-7b5a43309652
7152024-12-18T20:00:34.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 75ecb28d-2914-43ee-a14b-96b1f645e1ba response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
7162024-12-18T20:00:34.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7172024-12-18T20:00:34.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182024-12-18T20:00:34.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7192024-12-18T20:00:34.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7202024-12-18T20:00:34.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7212024-12-18T20:00:34.097ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7222024-12-18T20:00:34.097ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7232024-12-18T20:00:34.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7242024-12-18T20:00:34.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7252024-12-18T20:00:34.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7262024-12-18T20:00:34.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7272024-12-18T20:00:34.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7282024-12-18T20:00:34.121ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 524.777714ms iteration = 25 status = {}
7292024-12-18T20:00:34.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7302024-12-18T20:00:34.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "15567194-cb8a-4f26-a0f0-597ab86ad758", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7312024-12-18T20:00:34.149ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7322024-12-18T20:00:34.154ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "64a4036a-76c6-4c95-bc54-54df7c5873a8", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7332024-12-18T20:00:34.154ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7342024-12-18T20:00:34.156ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "52be0d77-a424-4ece-b390-fe8bc091892e", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7352024-12-18T20:00:34.156ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7362024-12-18T20:00:34.157ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7372024-12-18T20:00:34.157ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
7382024-12-18T20:00:34.157ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9445081e-a760-4ac7-a774-8f8ed1eca57a", "content-length": "1", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
7392024-12-18T20:00:34.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 562.587131ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7402024-12-18T20:00:34.160ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7412024-12-18T20:00:34.160ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 563.768736ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7422024-12-18T20:00:34.161ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 563.988941ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
7432024-12-18T20:00:34.161ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7442024-12-18T20:00:34.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7452024-12-18T20:00:34.163ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 567.068054ms iteration = 25 status = null
7462024-12-18T20:00:34.170ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7472024-12-18T20:00:34.170ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8fc962cf-e51f-448b-b0b6-3c8cab569201 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7482024-12-18T20:00:34.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7492024-12-18T20:00:34.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7502024-12-18T20:00:34.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7512024-12-18T20:00:34.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7522024-12-18T20:00:34.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7532024-12-18T20:00:34.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7542024-12-18T20:00:34.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7552024-12-18T20:00:34.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7562024-12-18T20:00:34.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7572024-12-18T20:00:34.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7582024-12-18T20:00:34.176ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c5344268-eb33-4765-9d91-b9438861661e dns_zone_name = oxide.test found_so_far = 1 version = 2
7592024-12-18T20:00:34.176ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7602024-12-18T20:00:34.176ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 19:48:35.279811 UTC dns_group = external generation = 2
7612024-12-18T20:00:34.176ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 580.181773ms iteration = 14 status = {"generation":2}
7622024-12-18T20:00:34.177ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {bfb560e0-429e-473e-a379-6f8c8b01bf4b: {10.151.2.176: {2653237a-012f-4e42-a58d-0c5bef0b2a48}, 10.151.2.175: {2653237a-012f-4e42-a58d-0c5bef0b2a48}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7632024-12-18T20:00:34.177ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7642024-12-18T20:00:34.177ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e9d39f11-df23-454f-b0e0-00814f299026", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
7652024-12-18T20:00:34.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7662024-12-18T20:00:34.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7672024-12-18T20:00:34.178ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8fc962cf-e51f-448b-b0b6-3c8cab569201 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7682024-12-18T20:00:34.178ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7692024-12-18T20:00:34.178ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 19:48:33.465914 UTC dns_group = internal generation = 1
7702024-12-18T20:00:34.178ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 581.898039ms iteration = 14 status = {"generation":1}
7712024-12-18T20:00:34.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7722024-12-18T20:00:34.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7732024-12-18T20:00:34.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7742024-12-18T20:00:34.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7752024-12-18T20:00:34.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7762024-12-18T20:00:34.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7772024-12-18T20:00:34.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7782024-12-18T20:00:34.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7792024-12-18T20:00:34.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7802024-12-18T20:00:34.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7812024-12-18T20:00:34.196ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7822024-12-18T20:00:34.196ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7832024-12-18T20:00:34.196ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7842024-12-18T20:00:34.196ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c8cc4ed4-41d1-482c-9544-917e6ddbffa7", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
7852024-12-18T20:00:34.198ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 601.276857ms iteration = 26 status = {}
7862024-12-18T20:00:34.205ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7872024-12-18T20:00:34.205ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 607.75178ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7882024-12-18T20:00:34.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7892024-12-18T20:00:34.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7902024-12-18T20:00:34.279ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c592ee00-6719-4702-903e-a4aee00a8af1, rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(37c692d6-efbe-4d30-b3c8-683fe7cd5daa) } rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
7912024-12-18T20:00:34.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7922024-12-18T20:00:34.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7932024-12-18T20:00:34.285ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7942024-12-18T20:00:34.285ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "99dca07c-dd29-4d22-8405-75a45765781a", "content-length": "809", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
7952024-12-18T20:00:34.286ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(837593) }} sled = sock
7962024-12-18T20:00:34.286ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7972024-12-18T20:00:34.286ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7982024-12-18T20:00:34.288ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 690.961632ms iteration = 25 status = {}
7992024-12-18T20:00:34.288ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8002024-12-18T20:00:34.289ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3dd7610-c7b1-4d10-bd76-8bd6f46e230a", "content-length": "134", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
8012024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8022024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 37c692d6-efbe-4d30-b3c8-683fe7cd5daa
8032024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8042024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8052024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8062024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8072024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8082024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8092024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8102024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8112024-12-18T20:00:34.289ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
8122024-12-18T20:00:34.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8132024-12-18T20:00:34.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8142024-12-18T20:00:34.292ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8152024-12-18T20:00:34.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc858893-fbcc-4043-b026-b07ba37baecb", "content-length": "2", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
8162024-12-18T20:00:34.292ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8172024-12-18T20:00:34.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "484398e9-bc13-4b18-a793-92156fe91c0b", "content-length": "52", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
8182024-12-18T20:00:34.292ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
8192024-12-18T20:00:34.292ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8202024-12-18T20:00:34.389ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c420f20d-de36-4b4d-ae9a-4c24ee4b657a", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
8212024-12-18T20:00:34.389ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch = Switch0
8222024-12-18T20:00:34.389ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8232024-12-18T20:00:34.389ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "23dbae4e-5e93-41c7-bb62-7d9b93cc407a", "content-length": "682", "date": "Wed, 18 Dec 2024 20:00:33 GMT"} })
8242024-12-18T20:00:34.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8252024-12-18T20:00:34.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8262024-12-18T20:00:34.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8272024-12-18T20:00:34.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8282024-12-18T20:00:34.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8292024-12-18T20:00:34.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8302024-12-18T20:00:34.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8312024-12-18T20:00:34.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8322024-12-18T20:00:34.407ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 810.49742ms iteration = 25 status = {}
8332024-12-18T20:00:34.564ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3985 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 1ce1a39b-a0df-43c9-bc4e-b6cd5fb39fd8 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
8342024-12-18T20:00:35.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = dce92847-9fec-41e8-9eef-98314e494e2c roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8352024-12-18T20:00:35.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = dce92847-9fec-41e8-9eef-98314e494e2c resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8362024-12-18T20:00:35.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = dce92847-9fec-41e8-9eef-98314e494e2c response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8372024-12-18T20:00:36.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 63587084-90e7-4406-b47f-b410577dff80 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8382024-12-18T20:00:36.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 63587084-90e7-4406-b47f-b410577dff80 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8392024-12-18T20:00:36.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 63587084-90e7-4406-b47f-b410577dff80 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8402024-12-18T20:00:37.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 921655ed-10f6-43b3-9855-e84ccc3697bd roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8412024-12-18T20:00:37.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 921655ed-10f6-43b3-9855-e84ccc3697bd resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8422024-12-18T20:00:37.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 921655ed-10f6-43b3-9855-e84ccc3697bd response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8432024-12-18T20:00:38.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = aef619b1-ec08-4eec-a5b2-dcfd04d6ff35 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8442024-12-18T20:00:38.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = aef619b1-ec08-4eec-a5b2-dcfd04d6ff35 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8452024-12-18T20:00:38.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = aef619b1-ec08-4eec-a5b2-dcfd04d6ff35 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8462024-12-18T20:00:39.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a0074a32-cf1e-44bf-8017-609c7cc5b39e roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8472024-12-18T20:00:39.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a0074a32-cf1e-44bf-8017-609c7cc5b39e resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8482024-12-18T20:00:39.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a0074a32-cf1e-44bf-8017-609c7cc5b39e response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8492024-12-18T20:00:40.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = cd77546f-eab6-44da-bff0-8dad5f383e43 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8502024-12-18T20:00:40.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = cd77546f-eab6-44da-bff0-8dad5f383e43 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8512024-12-18T20:00:40.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = cd77546f-eab6-44da-bff0-8dad5f383e43 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8522024-12-18T20:00:41.211ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 38eb545e-16a0-4a3d-a0f2-94c80e2323b6 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-18T20:00:41.211023444Z }
8532024-12-18T20:00:41.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 38eb545e-16a0-4a3d-a0f2-94c80e2323b6 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8542024-12-18T20:00:41.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 38eb545e-16a0-4a3d-a0f2-94c80e2323b6 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8552024-12-18T20:00:41.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56383 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 38eb545e-16a0-4a3d-a0f2-94c80e2323b6 response_code = 204 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8562024-12-18T20:00:41.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b47081fc-e569-4125-a134-88de6681ac99 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8572024-12-18T20:00:41.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b47081fc-e569-4125-a134-88de6681ac99 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8582024-12-18T20:00:41.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b47081fc-e569-4125-a134-88de6681ac99 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8592024-12-18T20:00:42.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8cfa492b-0d14-49f1-99f0-480190cbd305 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8602024-12-18T20:00:42.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8cfa492b-0d14-49f1-99f0-480190cbd305 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8612024-12-18T20:00:42.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8cfa492b-0d14-49f1-99f0-480190cbd305 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8622024-12-18T20:00:43.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 957f2a45-9d50-464d-bc82-6deddd6855b9 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8632024-12-18T20:00:43.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 957f2a45-9d50-464d-bc82-6deddd6855b9 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8642024-12-18T20:00:43.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 957f2a45-9d50-464d-bc82-6deddd6855b9 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
8652024-12-18T20:00:43.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
8662024-12-18T20:00:43.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8672024-12-18T20:00:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8682024-12-18T20:00:43.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
8692024-12-18T20:00:43.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8702024-12-18T20:00:43.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8712024-12-18T20:00:43.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8722024-12-18T20:00:43.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8732024-12-18T20:00:43.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8742024-12-18T20:00:43.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8752024-12-18T20:00:43.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8762024-12-18T20:00:43.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8772024-12-18T20:00:43.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8782024-12-18T20:00:43.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8792024-12-18T20:00:43.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8802024-12-18T20:00:43.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
8812024-12-18T20:00:43.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8822024-12-18T20:00:43.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8832024-12-18T20:00:43.670ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
8842024-12-18T20:00:43.670ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.325668ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
8852024-12-18T20:00:43.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.963835ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8862024-12-18T20:00:43.833ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T20:00:43.833339190Z }
8872024-12-18T20:00:43.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8882024-12-18T20:00:43.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8892024-12-18T20:00:43.899ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652 vmm_needs_update = true
8902024-12-18T20:00:43.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8912024-12-18T20:00:43.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8922024-12-18T20:00:43.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8932024-12-18T20:00:43.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8942024-12-18T20:00:43.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8952024-12-18T20:00:43.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8962024-12-18T20:00:43.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8972024-12-18T20:00:43.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8982024-12-18T20:00:43.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
8992024-12-18T20:00:43.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9002024-12-18T20:00:43.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9012024-12-18T20:00:43.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9022024-12-18T20:00:43.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9032024-12-18T20:00:43.917ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9066e168-08ec-47af-a018-fa1edb0a15cb, lookup_type: ById(9066e168-08ec-47af-a018-fa1edb0a15cb) }, key: f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0, lookup_type: ById(f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0) }, key: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5, lookup_type: ById(d1132c69-1a7c-4cdf-9c74-13d3bbf109f5) } result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9042024-12-18T20:00:43.917ZINFOnexus (dropshot_internal): starting update saga for d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T20:00:43.833339190Z }
9052024-12-18T20:00:43.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84016 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 response_code = 204 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9062024-12-18T20:00:43.917ZDEBGnexus (dropshot_internal): preparing instance-update saga for d1132c69-1a7c-4cdf-9c74-13d3bbf109f5... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 26f277d1-65b1-466d-a5f0-4895f908dce0 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9072024-12-18T20:00:43.917ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update
9082024-12-18T20:00:43.917ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"d1132c69-1a7c-4cdf-9c74-13d3bbf109f5","lookup_type":{"ById":"d1132c69-1a7c-4cdf-9c74-13d3bbf109f5"},"parent":{"key":"f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0","lookup_type":{"ById":"f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0"},"parent":{"key":"9066e168-08ec-47af-a018-fa1edb0a15cb","lookup_type":{"ById":"9066e168-08ec-47af-a018-fa1edb0a15cb"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9092024-12-18T20:00:43.917ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update
9102024-12-18T20:00:43.917ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d855aaed-427c-4787-aa36-76bd53f31f45 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T20:00:43.833339190Z }
9112024-12-18T20:00:43.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d855aaed-427c-4787-aa36-76bd53f31f45 roles = RoleSet { roles: {} } uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9122024-12-18T20:00:43.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d855aaed-427c-4787-aa36-76bd53f31f45 resource = Database result = Ok(()) uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9132024-12-18T20:00:43.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3841 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d855aaed-427c-4787-aa36-76bd53f31f45 response_code = 204 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
9142024-12-18T20:00:43.979ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update
9152024-12-18T20:00:43.979ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9162024-12-18T20:00:43.979ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9172024-12-18T20:00:43.979ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
9182024-12-18T20:00:44.000ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9192024-12-18T20:00:44.000ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
9202024-12-18T20:00:44.017ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9212024-12-18T20:00:44.017ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
9222024-12-18T20:00:44.030ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9232024-12-18T20:00:44.030ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d945345e-2f36-4d6b-addf-e57dee297d0a")) node_id = 0 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
9242024-12-18T20:00:44.042ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9252024-12-18T20:00:44.042ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
9262024-12-18T20:00:44.067ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update
9272024-12-18T20:00:44.067ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9282024-12-18T20:00:44.067ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9292024-12-18T20:00:44.070ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9302024-12-18T20:00:44.070ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9312024-12-18T20:00:44.072ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9322024-12-18T20:00:44.072ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9332024-12-18T20:00:44.074ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9342024-12-18T20:00:44.074ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9352024-12-18T20:00:44.075ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9362024-12-18T20:00:44.075ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9372024-12-18T20:00:44.077ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9382024-12-18T20:00:44.077ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9392024-12-18T20:00:44.078ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9402024-12-18T20:00:44.081ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9066e168-08ec-47af-a018-fa1edb0a15cb, lookup_type: ById(9066e168-08ec-47af-a018-fa1edb0a15cb) }, key: f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0, lookup_type: ById(f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0) }, key: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5, lookup_type: ById(d1132c69-1a7c-4cdf-9c74-13d3bbf109f5) } result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9412024-12-18T20:00:44.081ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance updater_id = d945345e-2f36-4d6b-addf-e57dee297d0a
9422024-12-18T20:00:44.081ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9432024-12-18T20:00:44.082ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9442024-12-18T20:00:44.106ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance updater_id = d945345e-2f36-4d6b-addf-e57dee297d0a
9452024-12-18T20:00:44.106ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9462024-12-18T20:00:44.106ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance
9472024-12-18T20:00:44.118ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 locked_gen = Generation(Generation(2)) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = LockInstance updater_id = d945345e-2f36-4d6b-addf-e57dee297d0a
9482024-12-18T20:00:44.120ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9492024-12-18T20:00:44.120ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d945345e-2f36-4d6b-addf-e57dee297d0a")}) node_id = 1 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
9502024-12-18T20:00:44.129ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9512024-12-18T20:00:44.129ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
9522024-12-18T20:00:44.140ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9532024-12-18T20:00:44.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9542024-12-18T20:00:44.142ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9552024-12-18T20:00:44.142ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9562024-12-18T20:00:44.143ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9572024-12-18T20:00:44.143ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9582024-12-18T20:00:44.145ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9592024-12-18T20:00:44.148ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9066e168-08ec-47af-a018-fa1edb0a15cb, lookup_type: ById(9066e168-08ec-47af-a018-fa1edb0a15cb) }, key: f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0, lookup_type: ById(f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0) }, key: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5, lookup_type: ById(d1132c69-1a7c-4cdf-9c74-13d3bbf109f5) } result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9602024-12-18T20:00:44.148ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9612024-12-18T20:00:44.148ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
9622024-12-18T20:00:44.158ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 847fe597-97bb-407a-9591-7b5a43309652, time_created: 2024-12-18T20:00:22.983196Z, time_deleted: None, instance_id: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5, sled_id: 58ee29db-9185-4216-97e8-559d204ec1d2, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-18T20:00:43.833339Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-18T20:00:20.761019Z, gen: Generation(Generation(3)), propolis_id: Some(847fe597-97bb-407a-9591-7b5a43309652), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(847fe597-97bb-407a-9591-7b5a43309652 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-18T20:00:44.158870096Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
9632024-12-18T20:00:44.158ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
9642024-12-18T20:00:44.159ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"d1132c69-1a7c-4cdf-9c74-13d3bbf109f5","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"847fe597-97bb-407a-9591-7b5a43309652"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"d1132c69-1a7c-4cdf-9c74-13d3bbf109f5","lookup_type":{"ById":"d1132c69-1a7c-4cdf-9c74-13d3bbf109f5"},"parent":{"key":"f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0","lookup_type":{"ById":"f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0"},"parent":{"key":"9066e168-08ec-47af-a018-fa1edb0a15cb","lookup_type":{"ById":"9066e168-08ec-47af-a018-fa1edb0a15cb"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"d945345e-2f36-4d6b-addf-e57dee297d0a"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0","ram_diff":1073741824},"destroy_active_vmm":"847fe597-97bb-407a-9591-7b5a43309652","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-18T20:00:44.158870096Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9652024-12-18T20:00:44.159ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
9662024-12-18T20:00:44.214ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
9672024-12-18T20:00:44.214ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9682024-12-18T20:00:44.214ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9692024-12-18T20:00:44.214ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
9702024-12-18T20:00:44.237ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9712024-12-18T20:00:44.237ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
9722024-12-18T20:00:44.244ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9732024-12-18T20:00:44.244ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
9742024-12-18T20:00:44.256ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9752024-12-18T20:00:44.256ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("56d3e242-5130-4920-a75b-212745e9338d")) node_id = 0 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
9762024-12-18T20:00:44.260ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9772024-12-18T20:00:44.260ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
9782024-12-18T20:00:44.271ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 parent_lock = UpdaterLock { updater_id: d945345e-2f36-4d6b-addf-e57dee297d0a, locked_gen: Generation(Generation(2)) } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
9792024-12-18T20:00:44.271ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = BecomeUpdater
9802024-12-18T20:00:44.271ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = BecomeUpdater
9812024-12-18T20:00:44.307ZDEBGnexus (SagaExecutor): inherited lock from d945345e-2f36-4d6b-addf-e57dee297d0a to 56d3e242-5130-4920-a75b-212745e9338d actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = d945345e-2f36-4d6b-addf-e57dee297d0a saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = BecomeUpdater updater_id = 56d3e242-5130-4920-a75b-212745e9338d
9822024-12-18T20:00:44.307ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
9832024-12-18T20:00:44.307ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9842024-12-18T20:00:44.307ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("56d3e242-5130-4920-a75b-212745e9338d")}) node_id = 1 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
9852024-12-18T20:00:44.313ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9862024-12-18T20:00:44.313ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
9872024-12-18T20:00:44.328ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9882024-12-18T20:00:44.328ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
9892024-12-18T20:00:44.340ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
9902024-12-18T20:00:44.340ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
9912024-12-18T20:00:44.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a113522c-d878-442f-9d15-f10129ace102 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
9922024-12-18T20:00:44.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a113522c-d878-442f-9d15-f10129ace102 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
9932024-12-18T20:00:44.343ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
9942024-12-18T20:00:44.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a113522c-d878-442f-9d15-f10129ace102 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
9952024-12-18T20:00:44.346ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5
9962024-12-18T20:00:44.348ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UpdateNetworkConfig
9972024-12-18T20:00:44.349ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UpdateNetworkConfig
9982024-12-18T20:00:44.351ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UpdateNetworkConfig
9992024-12-18T20:00:44.351ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UpdateNetworkConfig
10002024-12-18T20:00:44.353ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
10012024-12-18T20:00:44.353ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UpdateNetworkConfig
10022024-12-18T20:00:44.353ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UpdateNetworkConfig
10032024-12-18T20:00:44.355ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
10042024-12-18T20:00:44.355ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10052024-12-18T20:00:44.355ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10062024-12-18T20:00:44.357ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
10072024-12-18T20:00:44.358ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
10082024-12-18T20:00:44.358ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10092024-12-18T20:00:44.358ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10102024-12-18T20:00:44.362ZDEBGnexus: notifying dendrite of updates instance_id = Some(d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 (instance)) switch = switch0
10112024-12-18T20:00:44.363ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1719, tv_nsec: 650724914 } })
10122024-12-18T20:00:44.363ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
10132024-12-18T20:00:44.393ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10142024-12-18T20:00:44.393ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10152024-12-18T20:00:44.394ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af08554e-ff25-4458-bbf3-2ef71b702f5d", "content-length": "26", "date": "Wed, 18 Dec 2024 20:00:44 GMT"} })
10162024-12-18T20:00:44.394ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10172024-12-18T20:00:44.394ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10182024-12-18T20:00:44.427ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
10192024-12-18T20:00:44.427ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9ac8890-517f-43e0-bf4f-fd6d3304b09c", "content-length": "4", "date": "Wed, 18 Dec 2024 20:00:44 GMT"} })
10202024-12-18T20:00:44.430ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10212024-12-18T20:00:44.430ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10222024-12-18T20:00:44.435ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10232024-12-18T20:00:44.435ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10242024-12-18T20:00:44.449ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ReleaseVirtualProvisioning
10252024-12-18T20:00:44.449ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ReleaseVirtualProvisioning
10262024-12-18T20:00:44.505ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-18T20:00:44.452110Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9066e168-08ec-47af-a018-fa1edb0a15cb, time_modified: Some(2024-12-18T20:00:44.452110Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0, time_modified: Some(2024-12-18T20:00:44.452110Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
10272024-12-18T20:00:44.505ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10282024-12-18T20:00:44.505ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10292024-12-18T20:00:44.530ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10302024-12-18T20:00:44.530ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10312024-12-18T20:00:44.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 20b5ef7f-0fbd-4524-8234-6c4165f415a0 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
10322024-12-18T20:00:44.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 20b5ef7f-0fbd-4524-8234-6c4165f415a0 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
10332024-12-18T20:00:44.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 20b5ef7f-0fbd-4524-8234-6c4165f415a0 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
10342024-12-18T20:00:44.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 13e057b1-da51-4c84-9564-3d03631fcb55 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
10352024-12-18T20:00:44.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 13e057b1-da51-4c84-9564-3d03631fcb55 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
10362024-12-18T20:00:44.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 13e057b1-da51-4c84-9564-3d03631fcb55 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
10372024-12-18T20:00:44.554ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
10382024-12-18T20:00:44.556ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UnassignOximeterProducer
10392024-12-18T20:00:44.557ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UnassignOximeterProducer
10402024-12-18T20:00:44.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1357 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 64d36e50-8e10-4a2b-97e4-cdbb1f2c9891 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
10412024-12-18T20:00:44.577ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 producer_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
10422024-12-18T20:00:44.577ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UnassignOximeterProducer
10432024-12-18T20:00:44.577ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = UnassignOximeterProducer
10442024-12-18T20:00:44.620ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
10452024-12-18T20:00:44.632ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/d1132c69-1a7c-4cdf-9c74-13d3bbf109f5
10462024-12-18T20:00:44.683ZDEBGnexus (SagaExecutor): client response oximeter-collector = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/d1132c69-1a7c-4cdf-9c74-13d3bbf109f5", status: 204, headers: {"x-request-id": "d38571be-ed45-406b-8f84-1731037ec12f", "date": "Wed, 18 Dec 2024 20:00:44 GMT"} }) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
10472024-12-18T20:00:44.683ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 producer_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
10482024-12-18T20:00:44.685ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10492024-12-18T20:00:44.685ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10502024-12-18T20:00:44.690ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10512024-12-18T20:00:44.690ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10522024-12-18T20:00:44.697ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 lock = UpdaterLock { updater_id: 56d3e242-5130-4920-a75b-212745e9338d, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-18T20:00:44.158870096Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
10532024-12-18T20:00:44.697ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = CommitInstanceUpdates
10542024-12-18T20:00:44.697ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = CommitInstanceUpdates
10552024-12-18T20:00:44.884ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 new_runtime = InstanceRuntimeState { time_updated: 2024-12-18T20:00:44.158870096Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
10562024-12-18T20:00:44.884ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10572024-12-18T20:00:44.884ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10582024-12-18T20:00:44.884ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
10592024-12-18T20:00:44.884ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
10602024-12-18T20:00:44.884ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10612024-12-18T20:00:44.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10622024-12-18T20:00:44.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10632024-12-18T20:00:44.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10642024-12-18T20:00:44.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10652024-12-18T20:00:44.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10662024-12-18T20:00:44.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10672024-12-18T20:00:44.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10682024-12-18T20:00:44.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10692024-12-18T20:00:44.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10702024-12-18T20:00:44.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10712024-12-18T20:00:44.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10722024-12-18T20:00:44.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10732024-12-18T20:00:44.899ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10742024-12-18T20:00:44.899ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10752024-12-18T20:00:44.909ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10762024-12-18T20:00:44.909ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("d1132c69-1a7c-4cdf-9c74-13d3bbf109f5"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("847fe597-97bb-407a-9591-7b5a43309652")}) node_id = 7 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10772024-12-18T20:00:44.924ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10782024-12-18T20:00:44.924ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10792024-12-18T20:00:44.925ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "94c78ee6-f3e9-493d-bdc0-1cc9382421a0", "content-length": "372", "date": "Wed, 18 Dec 2024 20:00:44 GMT"} })
10802024-12-18T20:00:44.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10812024-12-18T20:00:44.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10822024-12-18T20:00:44.928ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10832024-12-18T20:00:44.928ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10842024-12-18T20:00:44.938ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10852024-12-18T20:00:44.938ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10862024-12-18T20:00:44.959ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
10872024-12-18T20:00:44.960ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
10882024-12-18T20:00:44.984ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {bfb560e0-429e-473e-a379-6f8c8b01bf4b: {10.151.2.175: {2653237a-012f-4e42-a58d-0c5bef0b2a48}, 10.151.2.176: {2653237a-012f-4e42-a58d-0c5bef0b2a48}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
10892024-12-18T20:00:44.984ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
10902024-12-18T20:00:44.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f0a2ff0d-3ad7-4be5-8271-41089bf2cd78", "date": "Wed, 18 Dec 2024 20:00:44 GMT"} })
10912024-12-18T20:00:44.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10922024-12-18T20:00:44.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10932024-12-18T20:00:44.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10942024-12-18T20:00:44.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10952024-12-18T20:00:44.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10962024-12-18T20:00:44.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10972024-12-18T20:00:44.993ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
10982024-12-18T20:00:44.993ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ReleaseSledResources
10992024-12-18T20:00:44.994ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ReleaseSledResources
11002024-12-18T20:00:44.994ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11012024-12-18T20:00:44.994ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11022024-12-18T20:00:44.994ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "eeb9595f-5ccb-45c1-a6c1-bf26560198ca", "date": "Wed, 18 Dec 2024 20:00:44 GMT"} })
11032024-12-18T20:00:44.996ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 111.985953ms iteration = 27 status = {}
11042024-12-18T20:00:45.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11052024-12-18T20:00:45.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11062024-12-18T20:00:45.082ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11072024-12-18T20:00:45.082ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11082024-12-18T20:00:45.094ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11092024-12-18T20:00:45.094ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11102024-12-18T20:00:45.107ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
11112024-12-18T20:00:45.107ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = MarkVmmDeleted
11122024-12-18T20:00:45.108ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = MarkVmmDeleted
11132024-12-18T20:00:45.128ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11142024-12-18T20:00:45.128ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11152024-12-18T20:00:45.159ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11162024-12-18T20:00:45.159ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11172024-12-18T20:00:45.161ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11182024-12-18T20:00:45.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11192024-12-18T20:00:45.163ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11202024-12-18T20:00:45.163ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11212024-12-18T20:00:45.163ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11222024-12-18T20:00:45.165ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11232024-12-18T20:00:45.165ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11242024-12-18T20:00:45.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11252024-12-18T20:00:45.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11262024-12-18T20:00:45.168ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11272024-12-18T20:00:45.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11282024-12-18T20:00:45.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11292024-12-18T20:00:45.170ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11302024-12-18T20:00:45.171ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11312024-12-18T20:00:45.196ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11322024-12-18T20:00:45.196ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11332024-12-18T20:00:45.198ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11342024-12-18T20:00:45.198ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11352024-12-18T20:00:45.200ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11362024-12-18T20:00:45.200ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11372024-12-18T20:00:45.201ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11382024-12-18T20:00:45.201ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11392024-12-18T20:00:45.201ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8886cb6d-b781-427f-95f4-4f3ad188b904", "content-length": "691", "date": "Wed, 18 Dec 2024 20:00:44 GMT"} })
11402024-12-18T20:00:45.201ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11412024-12-18T20:00:45.201ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11422024-12-18T20:00:45.201ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11432024-12-18T20:00:45.203ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 318.976241ms iteration = 26 status = {}
11442024-12-18T20:00:45.204ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9066e168-08ec-47af-a018-fa1edb0a15cb, lookup_type: ById(9066e168-08ec-47af-a018-fa1edb0a15cb) }, key: f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0, lookup_type: ById(f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0) }, key: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5, lookup_type: ById(d1132c69-1a7c-4cdf-9c74-13d3bbf109f5) } result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11452024-12-18T20:00:45.204ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11462024-12-18T20:00:45.204ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_node = ChainSuccessorSaga
11472024-12-18T20:00:45.210ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 karmic_state = WillReincarnate needs_reincarnation = false saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update
11482024-12-18T20:00:45.210ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11492024-12-18T20:00:45.210ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11502024-12-18T20:00:45.246ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11512024-12-18T20:00:45.246ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11522024-12-18T20:00:45.252ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11532024-12-18T20:00:45.252ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11542024-12-18T20:00:45.266ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = d883738f-856b-4c1c-841e-1062b9e875ef sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11552024-12-18T20:00:45.266ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = d883738f-856b-4c1c-841e-1062b9e875ef
11562024-12-18T20:00:45.335ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11572024-12-18T20:00:45.335ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = d883738f-856b-4c1c-841e-1062b9e875ef saga_name = instance-update saga_result = SagaResult { saga_id: d883738f-856b-4c1c-841e-1062b9e875ef, saga_log: SagaLog { saga_id: d883738f-856b-4c1c-841e-1062b9e875ef, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("56d3e242-5130-4920-a75b-212745e9338d")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("56d3e242-5130-4920-a75b-212745e9338d")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("d1132c69-1a7c-4cdf-9c74-13d3bbf109f5"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("847fe597-97bb-407a-9591-7b5a43309652")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("d1132c69-1a7c-4cdf-9c74-13d3bbf109f5"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("847fe597-97bb-407a-9591-7b5a43309652")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("56d3e242-5130-4920-a75b-212745e9338d"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("56d3e242-5130-4920-a75b-212745e9338d")}} }) }
11582024-12-18T20:00:45.335ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = d883738f-856b-4c1c-841e-1062b9e875ef instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update
11592024-12-18T20:00:45.335ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11602024-12-18T20:00:45.335ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
11612024-12-18T20:00:45.355ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11622024-12-18T20:00:45.355ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
11632024-12-18T20:00:45.364ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11642024-12-18T20:00:45.364ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
11652024-12-18T20:00:45.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8d86ac6b-5be3-466b-8089-f8ce4eca85e8 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11662024-12-18T20:00:45.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8d86ac6b-5be3-466b-8089-f8ce4eca85e8 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11672024-12-18T20:00:45.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8d86ac6b-5be3-466b-8089-f8ce4eca85e8 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11682024-12-18T20:00:45.374ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 5956a177-077d-4474-93f6-8bc7b694982e sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11692024-12-18T20:00:45.374ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 5956a177-077d-4474-93f6-8bc7b694982e
11702024-12-18T20:00:45.402ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update sec_id = 1139ebda-6055-49a8-8243-f0019044de70
11712024-12-18T20:00:45.402ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 5956a177-077d-4474-93f6-8bc7b694982e saga_name = start-instance-update saga_result = SagaResult { saga_id: 5956a177-077d-4474-93f6-8bc7b694982e, saga_log: SagaLog { saga_id: 5956a177-077d-4474-93f6-8bc7b694982e, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("d945345e-2f36-4d6b-addf-e57dee297d0a")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d945345e-2f36-4d6b-addf-e57dee297d0a")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("d945345e-2f36-4d6b-addf-e57dee297d0a"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("d945345e-2f36-4d6b-addf-e57dee297d0a")}} }) }
11722024-12-18T20:00:46.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a5f5ae35-f90d-46f3-a993-2c31244f5941 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11732024-12-18T20:00:46.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a5f5ae35-f90d-46f3-a993-2c31244f5941 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11742024-12-18T20:00:46.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a5f5ae35-f90d-46f3-a993-2c31244f5941 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11752024-12-18T20:00:47.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 718faf6d-590b-49bb-b9d1-53cbb668c32d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11762024-12-18T20:00:47.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 718faf6d-590b-49bb-b9d1-53cbb668c32d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11772024-12-18T20:00:47.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 718faf6d-590b-49bb-b9d1-53cbb668c32d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11782024-12-18T20:00:48.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c76c5ae5-6a6c-4059-913f-01c6d56649dc roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11792024-12-18T20:00:48.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c76c5ae5-6a6c-4059-913f-01c6d56649dc resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11802024-12-18T20:00:48.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c76c5ae5-6a6c-4059-913f-01c6d56649dc response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11812024-12-18T20:00:49.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 16057737-4ad5-4b69-a404-de4974cc1ac6 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11822024-12-18T20:00:49.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 16057737-4ad5-4b69-a404-de4974cc1ac6 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11832024-12-18T20:00:49.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 16057737-4ad5-4b69-a404-de4974cc1ac6 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11842024-12-18T20:00:50.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9290616e-3f16-44ba-97b4-45bebc5be6ad roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11852024-12-18T20:00:50.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9290616e-3f16-44ba-97b4-45bebc5be6ad resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11862024-12-18T20:00:50.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9290616e-3f16-44ba-97b4-45bebc5be6ad response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11872024-12-18T20:00:51.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 026c4a56-fe00-428f-97c5-27c1a8880010 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11882024-12-18T20:00:51.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 026c4a56-fe00-428f-97c5-27c1a8880010 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11892024-12-18T20:00:51.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 026c4a56-fe00-428f-97c5-27c1a8880010 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11902024-12-18T20:00:52.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fd9ec259-02ed-44c3-abde-2cf0143fecaa roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11912024-12-18T20:00:52.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fd9ec259-02ed-44c3-abde-2cf0143fecaa resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11922024-12-18T20:00:52.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fd9ec259-02ed-44c3-abde-2cf0143fecaa response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11932024-12-18T20:00:53.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c570847b-7a5e-4a38-a1b1-7cb3e524c4be roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11942024-12-18T20:00:53.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c570847b-7a5e-4a38-a1b1-7cb3e524c4be resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11952024-12-18T20:00:53.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c570847b-7a5e-4a38-a1b1-7cb3e524c4be response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
11962024-12-18T20:00:53.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
11972024-12-18T20:00:53.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11982024-12-18T20:00:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11992024-12-18T20:00:53.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
12002024-12-18T20:00:53.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12012024-12-18T20:00:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12022024-12-18T20:00:53.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12032024-12-18T20:00:53.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12042024-12-18T20:00:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12052024-12-18T20:00:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12062024-12-18T20:00:53.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12072024-12-18T20:00:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12082024-12-18T20:00:53.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12092024-12-18T20:00:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12102024-12-18T20:00:53.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12112024-12-18T20:00:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
12122024-12-18T20:00:53.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12132024-12-18T20:00:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12142024-12-18T20:00:53.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
12152024-12-18T20:00:53.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.542664ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
12162024-12-18T20:00:53.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.872833ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12172024-12-18T20:00:54.562ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = b94865fe-91ee-4360-b471-3067c6eaa834 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
12182024-12-18T20:00:54.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7e360d9f-f1e1-48ad-be7a-6cab06e3fc80 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12192024-12-18T20:00:54.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7e360d9f-f1e1-48ad-be7a-6cab06e3fc80 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12202024-12-18T20:00:54.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7e360d9f-f1e1-48ad-be7a-6cab06e3fc80 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12212024-12-18T20:00:55.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ac21b76d-2f07-48da-8693-59293874d6d6 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12222024-12-18T20:00:55.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ac21b76d-2f07-48da-8693-59293874d6d6 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12232024-12-18T20:00:55.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ac21b76d-2f07-48da-8693-59293874d6d6 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12242024-12-18T20:00:56.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 75fed39e-37f7-4d6d-8aa8-d548d5a9bb78 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12252024-12-18T20:00:56.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 75fed39e-37f7-4d6d-8aa8-d548d5a9bb78 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12262024-12-18T20:00:56.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 75fed39e-37f7-4d6d-8aa8-d548d5a9bb78 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12272024-12-18T20:00:57.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c7c3d25c-1ba6-4e73-bc5b-c847cdff34a6 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12282024-12-18T20:00:57.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c7c3d25c-1ba6-4e73-bc5b-c847cdff34a6 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12292024-12-18T20:00:57.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c7c3d25c-1ba6-4e73-bc5b-c847cdff34a6 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12302024-12-18T20:00:58.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c30fffff-46b4-43ad-a121-6aecb3806f42 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12312024-12-18T20:00:58.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c30fffff-46b4-43ad-a121-6aecb3806f42 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12322024-12-18T20:00:58.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c30fffff-46b4-43ad-a121-6aecb3806f42 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12332024-12-18T20:00:59.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e2d8399a-fac4-4952-8c9f-475c435b42f3 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12342024-12-18T20:00:59.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e2d8399a-fac4-4952-8c9f-475c435b42f3 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12352024-12-18T20:00:59.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e2d8399a-fac4-4952-8c9f-475c435b42f3 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12362024-12-18T20:01:00.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fc959f99-3fe6-4ee8-bf71-3076379624c0 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12372024-12-18T20:01:00.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fc959f99-3fe6-4ee8-bf71-3076379624c0 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12382024-12-18T20:01:00.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fc959f99-3fe6-4ee8-bf71-3076379624c0 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12392024-12-18T20:01:01.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3a781635-c609-49ea-ad85-a66765abb4b6 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12402024-12-18T20:01:01.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3a781635-c609-49ea-ad85-a66765abb4b6 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12412024-12-18T20:01:01.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3a781635-c609-49ea-ad85-a66765abb4b6 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12422024-12-18T20:01:02.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1bf5a846-56a3-45f1-98ab-4c92b9807f47 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12432024-12-18T20:01:02.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1bf5a846-56a3-45f1-98ab-4c92b9807f47 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12442024-12-18T20:01:02.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1bf5a846-56a3-45f1-98ab-4c92b9807f47 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
12452024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
12462024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12472024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
12482024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
12492024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
12502024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12512024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12522024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12532024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12542024-12-18T20:01:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12552024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
12562024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
12572024-12-18T20:01:03.598ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12582024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12592024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12602024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
12612024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
12622024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12632024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12642024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
12652024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12662024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
12672024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12682024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
12692024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
12702024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12712024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
12722024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12732024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12742024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12752024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
12762024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12772024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
12782024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
12792024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12802024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12812024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
12822024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12832024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12842024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12852024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12862024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12872024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12882024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12892024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12902024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12912024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12922024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12932024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12942024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12952024-12-18T20:01:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12962024-12-18T20:01:03.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1738, tv_nsec: 888352188 } })
12972024-12-18T20:01:03.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1738, tv_nsec: 888471381 } })
12982024-12-18T20:01:03.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
12992024-12-18T20:01:03.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
13002024-12-18T20:01:03.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13012024-12-18T20:01:03.602ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.831969ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13022024-12-18T20:01:03.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13032024-12-18T20:01:03.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13042024-12-18T20:01:03.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13052024-12-18T20:01:03.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13062024-12-18T20:01:03.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13072024-12-18T20:01:03.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13082024-12-18T20:01:03.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13092024-12-18T20:01:03.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13102024-12-18T20:01:03.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13112024-12-18T20:01:03.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13122024-12-18T20:01:03.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13132024-12-18T20:01:03.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13142024-12-18T20:01:03.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13152024-12-18T20:01:03.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13162024-12-18T20:01:03.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13172024-12-18T20:01:03.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13182024-12-18T20:01:03.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13192024-12-18T20:01:03.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13202024-12-18T20:01:03.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13212024-12-18T20:01:03.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13222024-12-18T20:01:03.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13232024-12-18T20:01:03.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13242024-12-18T20:01:03.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13252024-12-18T20:01:03.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13262024-12-18T20:01:03.616ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1738, tv_nsec: 903429829 } })
13272024-12-18T20:01:03.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13282024-12-18T20:01:03.616ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
13292024-12-18T20:01:03.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13302024-12-18T20:01:03.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13312024-12-18T20:01:03.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13322024-12-18T20:01:03.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13332024-12-18T20:01:03.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13342024-12-18T20:01:03.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13352024-12-18T20:01:03.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13362024-12-18T20:01:03.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.86931ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
13372024-12-18T20:01:03.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13382024-12-18T20:01:03.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13392024-12-18T20:01:03.682ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13402024-12-18T20:01:03.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13412024-12-18T20:01:03.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
13422024-12-18T20:01:03.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13432024-12-18T20:01:03.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13442024-12-18T20:01:03.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.025409ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13452024-12-18T20:01:03.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 86.354686ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
13462024-12-18T20:01:03.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13472024-12-18T20:01:03.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13482024-12-18T20:01:03.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13492024-12-18T20:01:03.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13502024-12-18T20:01:03.689ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13512024-12-18T20:01:03.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13522024-12-18T20:01:03.695ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13532024-12-18T20:01:03.695ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13542024-12-18T20:01:03.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13552024-12-18T20:01:03.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13562024-12-18T20:01:03.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13572024-12-18T20:01:03.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13582024-12-18T20:01:03.698ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
13592024-12-18T20:01:03.698ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.872614ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
13602024-12-18T20:01:03.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13612024-12-18T20:01:03.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13622024-12-18T20:01:03.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13632024-12-18T20:01:03.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13642024-12-18T20:01:03.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13652024-12-18T20:01:03.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13662024-12-18T20:01:03.705ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13672024-12-18T20:01:03.705ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.659784ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
13682024-12-18T20:01:03.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 zone_address = fd00:1122:3344:101::2
13692024-12-18T20:01:03.717ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13702024-12-18T20:01:03.717ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13712024-12-18T20:01:03.717ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "61f1a6e9-a39a-4a22-8129-5143412aa231", "content-length": "26", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
13722024-12-18T20:01:03.717ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13732024-12-18T20:01:03.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13742024-12-18T20:01:03.720ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
13752024-12-18T20:01:03.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 127.679846ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13762024-12-18T20:01:03.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13772024-12-18T20:01:03.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
13782024-12-18T20:01:03.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13792024-12-18T20:01:03.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13802024-12-18T20:01:03.733ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 135.567818ms iteration = 26 status = 0
13812024-12-18T20:01:03.758ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 160.189695ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13822024-12-18T20:01:03.762ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13832024-12-18T20:01:03.762ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13842024-12-18T20:01:03.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13852024-12-18T20:01:03.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13862024-12-18T20:01:03.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 171.184431ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13872024-12-18T20:01:03.770ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
13882024-12-18T20:01:03.770ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13892024-12-18T20:01:03.771ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "775d23ad-8464-405e-b3a8-09ef1f71f5d8", "content-length": "26", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
13902024-12-18T20:01:03.771ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13912024-12-18T20:01:03.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13922024-12-18T20:01:03.775ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
13932024-12-18T20:01:03.775ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13942024-12-18T20:01:03.775ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0846f2cc-c481-4ae2-8812-5ccb412fb6d2", "content-length": "26", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
13952024-12-18T20:01:03.775ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13962024-12-18T20:01:03.777ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13972024-12-18T20:01:03.810ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13982024-12-18T20:01:03.810ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13992024-12-18T20:01:03.810ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 212.361748ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14002024-12-18T20:01:03.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14012024-12-18T20:01:03.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14022024-12-18T20:01:03.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2d03d8fd-f730-4043-abb1-d9c349facbd1 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
14032024-12-18T20:01:03.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2d03d8fd-f730-4043-abb1-d9c349facbd1 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
14042024-12-18T20:01:03.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2d03d8fd-f730-4043-abb1-d9c349facbd1 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
14052024-12-18T20:01:03.852ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 254.091367ms iteration = 30 status = {"physical_disks_added":0}
14062024-12-18T20:01:03.867ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 270.619946ms iteration = 26 status = {}
14072024-12-18T20:01:03.874ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14082024-12-18T20:01:03.875ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cedfc2e8-8acc-416f-95c6-d8e83b13e344", "content-length": "2", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14092024-12-18T20:01:03.876ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14102024-12-18T20:01:03.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14112024-12-18T20:01:03.879ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14122024-12-18T20:01:03.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14132024-12-18T20:01:03.879ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 282.171173ms iteration = 26 status = null
14142024-12-18T20:01:03.879ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9a0fe78-22be-4c11-9563-f978830dc6c1", "content-length": "372", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14152024-12-18T20:01:03.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14162024-12-18T20:01:03.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14172024-12-18T20:01:03.900ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
14182024-12-18T20:01:03.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14192024-12-18T20:01:03.901ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "01a2d354-37d5-4b7a-94c8-10eed9444ca4", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14202024-12-18T20:01:03.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14212024-12-18T20:01:03.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14222024-12-18T20:01:03.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14232024-12-18T20:01:03.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14242024-12-18T20:01:03.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14252024-12-18T20:01:03.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14262024-12-18T20:01:03.910ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14272024-12-18T20:01:03.910ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14282024-12-18T20:01:03.914ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6a3d71ac-e00b-41bb-baac-ff5e06470cdf", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14292024-12-18T20:01:03.916ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 317.827308ms iteration = 28 status = {}
14302024-12-18T20:01:03.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14312024-12-18T20:01:03.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14322024-12-18T20:01:03.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14332024-12-18T20:01:03.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14342024-12-18T20:01:03.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14352024-12-18T20:01:03.921ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c592ee00-6719-4702-903e-a4aee00a8af1, rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(37c692d6-efbe-4d30-b3c8-683fe7cd5daa) } rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
14362024-12-18T20:01:03.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14372024-12-18T20:01:03.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14382024-12-18T20:01:03.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14392024-12-18T20:01:03.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14402024-12-18T20:01:03.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14412024-12-18T20:01:03.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14422024-12-18T20:01:03.925ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14432024-12-18T20:01:03.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14442024-12-18T20:01:03.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14452024-12-18T20:01:03.927ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14462024-12-18T20:01:03.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "777d59c9-58c1-4c46-ab63-247dff09d540", "content-length": "134", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14472024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14482024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 37c692d6-efbe-4d30-b3c8-683fe7cd5daa
14492024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14502024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14512024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14522024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14532024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14542024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14552024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14562024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14572024-12-18T20:01:03.928ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
14582024-12-18T20:01:03.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14592024-12-18T20:01:03.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14602024-12-18T20:01:03.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14612024-12-18T20:01:03.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cf59e12-688e-4c11-9e8b-1fec4a269453", "content-length": "2", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14622024-12-18T20:01:03.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14632024-12-18T20:01:03.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee07448e-bee2-4ba6-b73f-deb7daa62e21", "content-length": "52", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14642024-12-18T20:01:03.931ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
14652024-12-18T20:01:03.931ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14662024-12-18T20:01:03.960ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14672024-12-18T20:01:03.961ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d707e1f-cf8c-4e7e-96b4-824245a5fa3a", "content-length": "691", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14682024-12-18T20:01:03.961ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14692024-12-18T20:01:03.961ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14702024-12-18T20:01:03.961ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14712024-12-18T20:01:03.963ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 364.791713ms iteration = 27 status = {}
14722024-12-18T20:01:04.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ce6e2562-b806-4d75-a81a-87534c3c196e", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14732024-12-18T20:01:04.033ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch = Switch0
14742024-12-18T20:01:04.033ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14752024-12-18T20:01:04.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bbc7b7b-210f-440b-9abd-21943b142e73", "content-length": "682", "date": "Wed, 18 Dec 2024 20:01:03 GMT"} })
14762024-12-18T20:01:04.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14772024-12-18T20:01:04.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14782024-12-18T20:01:04.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14792024-12-18T20:01:04.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14802024-12-18T20:01:04.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14812024-12-18T20:01:04.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14822024-12-18T20:01:04.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14832024-12-18T20:01:04.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14842024-12-18T20:01:04.051ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 453.175041ms iteration = 26 status = {}
14852024-12-18T20:01:04.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1322 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 71c0a239-0ec8-46c5-829f-bcb9ce59812d response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
14862024-12-18T20:01:04.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e21c6b70-8bb1-496e-ae35-19f0a2d13aa3 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
14872024-12-18T20:01:04.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e21c6b70-8bb1-496e-ae35-19f0a2d13aa3 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
14882024-12-18T20:01:04.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e21c6b70-8bb1-496e-ae35-19f0a2d13aa3 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
14892024-12-18T20:01:05.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d7b0003d-2d43-4e66-bfbe-db77d98a5206 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
14902024-12-18T20:01:05.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d7b0003d-2d43-4e66-bfbe-db77d98a5206 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
14912024-12-18T20:01:05.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d7b0003d-2d43-4e66-bfbe-db77d98a5206 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
14922024-12-18T20:01:06.309ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
14932024-12-18T20:01:06.309ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
14942024-12-18T20:01:06.341ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
14952024-12-18T20:01:06.341ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:34869
14962024-12-18T20:01:06.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34869 req_id = 9d8ab0dc-10e6-454d-96fe-7ee9e194ed55 roles = RoleSet { roles: {} } uri = /metrics/producers
14972024-12-18T20:01:06.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34869 req_id = 9d8ab0dc-10e6-454d-96fe-7ee9e194ed55 resource = Database result = Ok(()) uri = /metrics/producers
14982024-12-18T20:01:06.400ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = 1139ebda-6055-49a8-8243-f0019044de70
14992024-12-18T20:01:06.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59010 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34869 req_id = 9d8ab0dc-10e6-454d-96fe-7ee9e194ed55 response_code = 201 uri = /metrics/producers
15002024-12-18T20:01:06.400ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9d8ab0dc-10e6-454d-96fe-7ee9e194ed55", "content-length": "41", "date": "Wed, 18 Dec 2024 20:01:06 GMT"} })
15012024-12-18T20:01:06.401ZDEBGnexus (producer-registration-task): registered with nexus successfully
15022024-12-18T20:01:06.401ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
15032024-12-18T20:01:06.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 12b8679f-403f-411a-84c3-c043628348bf roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15042024-12-18T20:01:06.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 12b8679f-403f-411a-84c3-c043628348bf resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15052024-12-18T20:01:06.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 12b8679f-403f-411a-84c3-c043628348bf response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15062024-12-18T20:01:07.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3dd698f1-0142-46b8-b4d6-bec40adeccbf roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15072024-12-18T20:01:07.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3dd698f1-0142-46b8-b4d6-bec40adeccbf resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15082024-12-18T20:01:07.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3dd698f1-0142-46b8-b4d6-bec40adeccbf response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15092024-12-18T20:01:08.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 03ca5e0b-24e2-4e30-8244-d8529961822c roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15102024-12-18T20:01:08.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 03ca5e0b-24e2-4e30-8244-d8529961822c resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15112024-12-18T20:01:08.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 03ca5e0b-24e2-4e30-8244-d8529961822c response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15122024-12-18T20:01:09.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 81c563c2-a692-4c2f-aa93-48b701811bb3 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15132024-12-18T20:01:09.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 81c563c2-a692-4c2f-aa93-48b701811bb3 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15142024-12-18T20:01:09.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 81c563c2-a692-4c2f-aa93-48b701811bb3 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15152024-12-18T20:01:10.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0cb2b9fb-f00c-4088-880a-5027863268be roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15162024-12-18T20:01:10.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0cb2b9fb-f00c-4088-880a-5027863268be resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15172024-12-18T20:01:10.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0cb2b9fb-f00c-4088-880a-5027863268be response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15182024-12-18T20:01:12.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b07dd0c4-8d09-4ef1-9356-07fe8a12cad4 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15192024-12-18T20:01:12.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b07dd0c4-8d09-4ef1-9356-07fe8a12cad4 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15202024-12-18T20:01:12.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b07dd0c4-8d09-4ef1-9356-07fe8a12cad4 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15212024-12-18T20:01:13.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d208f500-16d1-41da-bde0-44e83d6ff8cc roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15222024-12-18T20:01:13.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d208f500-16d1-41da-bde0-44e83d6ff8cc resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15232024-12-18T20:01:13.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d208f500-16d1-41da-bde0-44e83d6ff8cc response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15242024-12-18T20:01:13.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
15252024-12-18T20:01:13.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15262024-12-18T20:01:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15272024-12-18T20:01:13.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
15282024-12-18T20:01:13.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15292024-12-18T20:01:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15302024-12-18T20:01:13.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15312024-12-18T20:01:13.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15322024-12-18T20:01:13.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15332024-12-18T20:01:13.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.923ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15342024-12-18T20:01:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15352024-12-18T20:01:13.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15362024-12-18T20:01:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15372024-12-18T20:01:13.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15382024-12-18T20:01:13.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15392024-12-18T20:01:13.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15402024-12-18T20:01:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
15412024-12-18T20:01:13.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15422024-12-18T20:01:13.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15432024-12-18T20:01:13.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
15442024-12-18T20:01:13.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.31265ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
15452024-12-18T20:01:14.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 263e28e1-a113-42d4-bcf1-ff4bbb1fa286 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15462024-12-18T20:01:14.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 263e28e1-a113-42d4-bcf1-ff4bbb1fa286 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15472024-12-18T20:01:14.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 263e28e1-a113-42d4-bcf1-ff4bbb1fa286 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15482024-12-18T20:01:14.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = f78161c7-b996-4a80-b282-83f13fa8682d roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
15492024-12-18T20:01:14.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = f78161c7-b996-4a80-b282-83f13fa8682d resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
15502024-12-18T20:01:14.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = f78161c7-b996-4a80-b282-83f13fa8682d response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
15512024-12-18T20:01:14.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = cbcdfc62-b824-464b-955f-502d07b83d67 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
15522024-12-18T20:01:14.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = cbcdfc62-b824-464b-955f-502d07b83d67 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
15532024-12-18T20:01:14.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = cbcdfc62-b824-464b-955f-502d07b83d67 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
15542024-12-18T20:01:14.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1243 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 4c91e096-9a35-4ee6-9d2a-788ea69067cc response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
15552024-12-18T20:01:15.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1fa939e4-6315-4d3b-8774-a7974861d9dd roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15562024-12-18T20:01:15.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1fa939e4-6315-4d3b-8774-a7974861d9dd resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15572024-12-18T20:01:15.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1fa939e4-6315-4d3b-8774-a7974861d9dd response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15582024-12-18T20:01:16.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 777da312-369f-4d7d-8fae-90b1232b33e7 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15592024-12-18T20:01:16.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 777da312-369f-4d7d-8fae-90b1232b33e7 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15602024-12-18T20:01:16.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 777da312-369f-4d7d-8fae-90b1232b33e7 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15612024-12-18T20:01:17.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e37fc9aa-4042-416d-9fce-b720e33b87d7 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15622024-12-18T20:01:17.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e37fc9aa-4042-416d-9fce-b720e33b87d7 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15632024-12-18T20:01:17.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e37fc9aa-4042-416d-9fce-b720e33b87d7 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15642024-12-18T20:01:18.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2f09b3fa-770a-4080-b312-03540f548a68 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15652024-12-18T20:01:18.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2f09b3fa-770a-4080-b312-03540f548a68 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15662024-12-18T20:01:18.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2f09b3fa-770a-4080-b312-03540f548a68 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15672024-12-18T20:01:19.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2b4c3b5a-ea5d-4bd0-bfb1-a1bbae8b7299 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15682024-12-18T20:01:19.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2b4c3b5a-ea5d-4bd0-bfb1-a1bbae8b7299 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15692024-12-18T20:01:19.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2b4c3b5a-ea5d-4bd0-bfb1-a1bbae8b7299 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15702024-12-18T20:01:20.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 040159a9-82e3-4d2a-9967-be9d3f3567c0 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15712024-12-18T20:01:20.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 040159a9-82e3-4d2a-9967-be9d3f3567c0 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15722024-12-18T20:01:20.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 040159a9-82e3-4d2a-9967-be9d3f3567c0 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15732024-12-18T20:01:21.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2984fd54-2c2c-4175-9204-7a92d8eaae3d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15742024-12-18T20:01:21.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2984fd54-2c2c-4175-9204-7a92d8eaae3d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15752024-12-18T20:01:21.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2984fd54-2c2c-4175-9204-7a92d8eaae3d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15762024-12-18T20:01:22.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7539de6f-1707-44bc-991f-008dc8ad85bf roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15772024-12-18T20:01:22.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7539de6f-1707-44bc-991f-008dc8ad85bf resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15782024-12-18T20:01:22.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7539de6f-1707-44bc-991f-008dc8ad85bf response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15792024-12-18T20:01:23.052ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:57090
15802024-12-18T20:01:23.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57090 req_id = d38b9d51-ccb2-4996-aa5e-5fcdc1068f87 roles = RoleSet { roles: {} } uri = /metrics/producers
15812024-12-18T20:01:23.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57090 req_id = d38b9d51-ccb2-4996-aa5e-5fcdc1068f87 resource = Database result = Ok(()) uri = /metrics/producers
15822024-12-18T20:01:23.065ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = bca08b9a-1cac-41a6-8b38-a39f5fb70f29
15832024-12-18T20:01:23.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13881 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57090 req_id = d38b9d51-ccb2-4996-aa5e-5fcdc1068f87 response_code = 201 uri = /metrics/producers
15842024-12-18T20:01:23.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8806925f-a529-4af4-be8e-b154f54fc905 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15852024-12-18T20:01:23.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8806925f-a529-4af4-be8e-b154f54fc905 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15862024-12-18T20:01:23.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8806925f-a529-4af4-be8e-b154f54fc905 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
15872024-12-18T20:01:23.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
15882024-12-18T20:01:23.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15892024-12-18T20:01:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15902024-12-18T20:01:23.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
15912024-12-18T20:01:23.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15922024-12-18T20:01:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15932024-12-18T20:01:23.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15942024-12-18T20:01:23.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15952024-12-18T20:01:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15962024-12-18T20:01:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15972024-12-18T20:01:23.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15982024-12-18T20:01:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15992024-12-18T20:01:23.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.42209ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16002024-12-18T20:01:23.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16012024-12-18T20:01:23.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16022024-12-18T20:01:23.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16032024-12-18T20:01:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
16042024-12-18T20:01:23.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16052024-12-18T20:01:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16062024-12-18T20:01:23.614ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
16072024-12-18T20:01:23.614ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.293276ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
16082024-12-18T20:01:24.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 850efa7f-8525-449b-bab5-343b40021015 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16092024-12-18T20:01:24.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 850efa7f-8525-449b-bab5-343b40021015 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16102024-12-18T20:01:24.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 850efa7f-8525-449b-bab5-343b40021015 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16112024-12-18T20:01:24.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1649 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = be2dbfc9-a5e4-4255-a78d-2636ec102dec response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
16122024-12-18T20:01:25.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b3c793b5-8377-4317-bbd1-0cee494cc721 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16132024-12-18T20:01:25.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b3c793b5-8377-4317-bbd1-0cee494cc721 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16142024-12-18T20:01:25.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b3c793b5-8377-4317-bbd1-0cee494cc721 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16152024-12-18T20:01:26.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 734a691e-779a-48f6-83af-631a108dc09e roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16162024-12-18T20:01:26.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 734a691e-779a-48f6-83af-631a108dc09e resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16172024-12-18T20:01:26.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 734a691e-779a-48f6-83af-631a108dc09e response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16182024-12-18T20:01:27.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c1b39e2a-ae3c-4c43-8761-a30e669aeaa8 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16192024-12-18T20:01:27.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c1b39e2a-ae3c-4c43-8761-a30e669aeaa8 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16202024-12-18T20:01:27.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c1b39e2a-ae3c-4c43-8761-a30e669aeaa8 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16212024-12-18T20:01:28.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9b450f14-489e-4a1f-801f-1a89d3b62173 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16222024-12-18T20:01:28.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9b450f14-489e-4a1f-801f-1a89d3b62173 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16232024-12-18T20:01:28.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9b450f14-489e-4a1f-801f-1a89d3b62173 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16242024-12-18T20:01:29.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 44e83430-e569-4e05-912e-651dffcad6d3 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16252024-12-18T20:01:29.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 44e83430-e569-4e05-912e-651dffcad6d3 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16262024-12-18T20:01:29.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 44e83430-e569-4e05-912e-651dffcad6d3 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16272024-12-18T20:01:29.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 3a023fd5-d1f3-470e-932a-5b4a5c827120 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
16282024-12-18T20:01:29.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 3a023fd5-d1f3-470e-932a-5b4a5c827120 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
16292024-12-18T20:01:29.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 3a023fd5-d1f3-470e-932a-5b4a5c827120 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
16302024-12-18T20:01:29.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 48656ca2-fa1a-4595-a41e-965a60d499ca roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
16312024-12-18T20:01:29.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 48656ca2-fa1a-4595-a41e-965a60d499ca resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
16322024-12-18T20:01:29.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 48656ca2-fa1a-4595-a41e-965a60d499ca response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
16332024-12-18T20:01:30.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8acde174-5ee7-477f-9587-914da07b68ab roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16342024-12-18T20:01:30.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8acde174-5ee7-477f-9587-914da07b68ab resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16352024-12-18T20:01:30.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8acde174-5ee7-477f-9587-914da07b68ab response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16362024-12-18T20:01:31.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 98a034db-ab6f-4042-882e-cb3cb44959a0 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16372024-12-18T20:01:31.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 98a034db-ab6f-4042-882e-cb3cb44959a0 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16382024-12-18T20:01:31.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 98a034db-ab6f-4042-882e-cb3cb44959a0 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16392024-12-18T20:01:32.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fa9d7f85-5c31-4354-aab7-bcecb01a3d2d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16402024-12-18T20:01:32.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fa9d7f85-5c31-4354-aab7-bcecb01a3d2d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16412024-12-18T20:01:32.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fa9d7f85-5c31-4354-aab7-bcecb01a3d2d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16422024-12-18T20:01:33.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 47135ac5-d510-40c8-9a46-5a3a758344c0 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16432024-12-18T20:01:33.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 47135ac5-d510-40c8-9a46-5a3a758344c0 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16442024-12-18T20:01:33.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 47135ac5-d510-40c8-9a46-5a3a758344c0 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
16452024-12-18T20:01:33.596ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
16462024-12-18T20:01:33.596ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
16472024-12-18T20:01:33.596ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 19:51:33.596931185 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16482024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
16492024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16502024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16512024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
16522024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
16532024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
16542024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16552024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
16562024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
16572024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16582024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
16592024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
16602024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16612024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16622024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
16632024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16642024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
16652024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16662024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16672024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
16682024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16692024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16702024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
16712024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
16722024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16732024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16742024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16752024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16762024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
16772024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
16782024-12-18T20:01:33.597ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
16792024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
16802024-12-18T20:01:33.597ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66
16812024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16822024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16832024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.03\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66"}
16842024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16852024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
16862024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
16872024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
16882024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16892024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16902024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
16912024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
16922024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16932024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
16942024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16952024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16962024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16972024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
16982024-12-18T20:01:33.597ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16992024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
17002024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17012024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17022024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
17032024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17042024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
17052024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17062024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
17072024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17082024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
17092024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17102024-12-18T20:01:33.597ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
17112024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17122024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
17132024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17142024-12-18T20:01:33.598ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e3d8b46-b399-4d3c-bc66-63409f4abd06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9da4e3ea-a57c-4b2b-81c3-7f374155d667.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9da4e3ea-a57c-4b2b-81c3-7f374155d667.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1768, tv_nsec: 885272307 } })
17152024-12-18T20:01:33.598ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73c17a86-f1fb-4102-92b8-0059f9ce4d77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89d5399b-5669-48fc-9549-d301f3010160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("967a5ab6-9437-47ac-b51c-7113605783e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("967a5ab6-9437-47ac-b51c-7113605783e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1768, tv_nsec: 885273707 } })
17162024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17172024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17182024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17192024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17202024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17212024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17222024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17232024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17242024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17252024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17262024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17272024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17282024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17292024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17302024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17312024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17322024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17332024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
17342024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.49069ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17352024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
17362024-12-18T20:01:33.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.640274ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
17372024-12-18T20:01:33.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17382024-12-18T20:01:33.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17392024-12-18T20:01:33.600ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.742737ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17402024-12-18T20:01:33.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17412024-12-18T20:01:33.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1768, tv_nsec: 888423112 } })
17422024-12-18T20:01:33.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
17432024-12-18T20:01:33.601ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 19:51:33.596931185 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17442024-12-18T20:01:33.601ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.466422ms iteration = 14 status = {"expiration":"2024-12-18T19:51:33.596931185Z","pruned":[]}
17452024-12-18T20:01:33.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17462024-12-18T20:01:33.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17472024-12-18T20:01:33.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17482024-12-18T20:01:33.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17492024-12-18T20:01:33.602ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1768, tv_nsec: 890347711 } })
17502024-12-18T20:01:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17512024-12-18T20:01:33.603ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
17522024-12-18T20:01:33.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17532024-12-18T20:01:33.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17542024-12-18T20:01:33.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17552024-12-18T20:01:33.605ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.363592ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
17562024-12-18T20:01:33.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17572024-12-18T20:01:33.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.701129ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
17582024-12-18T20:01:33.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17592024-12-18T20:01:33.607ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17602024-12-18T20:01:33.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17612024-12-18T20:01:33.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17622024-12-18T20:01:33.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17632024-12-18T20:01:33.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17642024-12-18T20:01:33.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652024-12-18T20:01:33.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17662024-12-18T20:01:33.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17672024-12-18T20:01:33.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17682024-12-18T20:01:33.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17692024-12-18T20:01:33.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17702024-12-18T20:01:33.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17712024-12-18T20:01:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17722024-12-18T20:01:33.613ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17732024-12-18T20:01:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17742024-12-18T20:01:33.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17752024-12-18T20:01:33.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17762024-12-18T20:01:33.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17772024-12-18T20:01:33.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17782024-12-18T20:01:33.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17792024-12-18T20:01:33.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17802024-12-18T20:01:33.621ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17812024-12-18T20:01:33.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17822024-12-18T20:01:33.624ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
17832024-12-18T20:01:33.624ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
17842024-12-18T20:01:33.624ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17852024-12-18T20:01:33.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17862024-12-18T20:01:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17872024-12-18T20:01:33.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882024-12-18T20:01:33.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17892024-12-18T20:01:33.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17902024-12-18T20:01:33.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17912024-12-18T20:01:33.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 37.923651ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17922024-12-18T20:01:33.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17932024-12-18T20:01:33.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17942024-12-18T20:01:33.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17952024-12-18T20:01:33.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17962024-12-18T20:01:33.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17972024-12-18T20:01:33.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17982024-12-18T20:01:33.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17992024-12-18T20:01:33.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18002024-12-18T20:01:33.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18012024-12-18T20:01:33.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18022024-12-18T20:01:33.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18032024-12-18T20:01:33.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18042024-12-18T20:01:33.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18052024-12-18T20:01:33.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18062024-12-18T20:01:33.685ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18072024-12-18T20:01:33.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18082024-12-18T20:01:33.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18092024-12-18T20:01:33.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18102024-12-18T20:01:33.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18112024-12-18T20:01:33.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18122024-12-18T20:01:33.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18132024-12-18T20:01:33.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18142024-12-18T20:01:33.698ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18152024-12-18T20:01:33.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18162024-12-18T20:01:33.704ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18172024-12-18T20:01:33.704ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
18182024-12-18T20:01:33.704ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
18192024-12-18T20:01:33.704ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 106.674024ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
18202024-12-18T20:01:33.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18212024-12-18T20:01:33.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18222024-12-18T20:01:33.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18232024-12-18T20:01:33.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18242024-12-18T20:01:33.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18252024-12-18T20:01:33.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
18262024-12-18T20:01:33.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18272024-12-18T20:01:33.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18282024-12-18T20:01:33.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
18292024-12-18T20:01:33.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18302024-12-18T20:01:33.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18312024-12-18T20:01:33.711ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18322024-12-18T20:01:33.711ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18332024-12-18T20:01:33.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18342024-12-18T20:01:33.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18352024-12-18T20:01:33.714ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.609368ms iteration = 27 status = 0
18362024-12-18T20:01:33.714ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 116.559548ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
18372024-12-18T20:01:33.715ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18382024-12-18T20:01:33.715ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18392024-12-18T20:01:33.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18402024-12-18T20:01:33.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18412024-12-18T20:01:33.716ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18422024-12-18T20:01:33.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18432024-12-18T20:01:33.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18442024-12-18T20:01:33.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.57678ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18452024-12-18T20:01:33.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18462024-12-18T20:01:33.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18472024-12-18T20:01:33.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18482024-12-18T20:01:33.721ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
18492024-12-18T20:01:33.721ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
18502024-12-18T20:01:33.721ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 123.674354ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
18512024-12-18T20:01:33.721ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18522024-12-18T20:01:33.721ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18532024-12-18T20:01:33.721ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18542024-12-18T20:01:33.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18552024-12-18T20:01:33.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18562024-12-18T20:01:33.723ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18572024-12-18T20:01:33.723ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8fc962cf-e51f-448b-b0b6-3c8cab569201 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18582024-12-18T20:01:33.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18592024-12-18T20:01:33.724ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1769, tv_nsec: 11365560 } })
18602024-12-18T20:01:33.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18612024-12-18T20:01:33.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18622024-12-18T20:01:33.724ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
18632024-12-18T20:01:33.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18642024-12-18T20:01:33.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18652024-12-18T20:01:33.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18662024-12-18T20:01:33.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18672024-12-18T20:01:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18682024-12-18T20:01:33.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18692024-12-18T20:01:33.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18702024-12-18T20:01:33.727ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18712024-12-18T20:01:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.046205ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18722024-12-18T20:01:33.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18732024-12-18T20:01:33.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18742024-12-18T20:01:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18752024-12-18T20:01:33.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18762024-12-18T20:01:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18772024-12-18T20:01:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18782024-12-18T20:01:33.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18792024-12-18T20:01:33.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18802024-12-18T20:01:33.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18812024-12-18T20:01:33.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18822024-12-18T20:01:33.734ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8fc962cf-e51f-448b-b0b6-3c8cab569201 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
18832024-12-18T20:01:33.734ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
18842024-12-18T20:01:33.734ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 19:48:33.465914 UTC dns_group = internal generation = 1
18852024-12-18T20:01:33.734ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 137.779624ms iteration = 15 status = {"generation":1}
18862024-12-18T20:01:33.737ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
18872024-12-18T20:01:33.737ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 140.295506ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
18882024-12-18T20:01:33.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
18892024-12-18T20:01:33.762ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18902024-12-18T20:01:33.763ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4c6775d-d695-413a-9dd4-6f12c6131a11", "content-length": "26", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
18912024-12-18T20:01:33.763ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18922024-12-18T20:01:33.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18932024-12-18T20:01:33.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18942024-12-18T20:01:33.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18952024-12-18T20:01:33.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 176.252075ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18962024-12-18T20:01:33.782ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18972024-12-18T20:01:33.782ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18982024-12-18T20:01:33.782ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 184.861792ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18992024-12-18T20:01:33.788ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 190.60459ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19002024-12-18T20:01:33.790ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19012024-12-18T20:01:33.790ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c5344268-eb33-4765-9d91-b9438861661e dns_zone_name = oxide.test found_so_far = 0 version = 2
19022024-12-18T20:01:33.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19032024-12-18T20:01:33.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19042024-12-18T20:01:33.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052024-12-18T20:01:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19062024-12-18T20:01:33.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19072024-12-18T20:01:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19082024-12-18T20:01:33.798ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c5344268-eb33-4765-9d91-b9438861661e dns_zone_name = oxide.test found_so_far = 1 version = 2
19092024-12-18T20:01:33.798ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19102024-12-18T20:01:33.798ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 19:48:35.279811 UTC dns_group = external generation = 2
19112024-12-18T20:01:33.798ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 201.563376ms iteration = 15 status = {"generation":2}
19122024-12-18T20:01:33.803ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
19132024-12-18T20:01:33.812ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T19:48:29.764483Z, time_modified: 2024-12-18T19:48:29.764483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9066e168-08ec-47af-a018-fa1edb0a15cb, db_silo: Silo { identity: SiloIdentity { id: 9066e168-08ec-47af-a018-fa1edb0a15cb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T19:48:35.229287Z, time_modified: 2024-12-18T19:48:35.229287Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9066e168-08ec-47af-a018-fa1edb0a15cb, db_silo: Silo { identity: SiloIdentity { id: 9066e168-08ec-47af-a018-fa1edb0a15cb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T19:48:35.229287Z, time_modified: 2024-12-18T19:48:35.229287Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e" }] }) }
19142024-12-18T20:01:33.812ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 215.732727ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9066e168-08ec-47af-a018-fa1edb0a15cb","tls_certs":["828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e"]}},"default_endpoint":{"silo_id":"9066e168-08ec-47af-a018-fa1edb0a15cb","tls_certs":["828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19152024-12-18T20:01:33.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19162024-12-18T20:01:33.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19172024-12-18T20:01:33.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19182024-12-18T20:01:33.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19192024-12-18T20:01:33.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19202024-12-18T20:01:33.845ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 248.304527ms iteration = 31 status = {"physical_disks_added":0}
19212024-12-18T20:01:33.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19222024-12-18T20:01:33.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19232024-12-18T20:01:33.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19242024-12-18T20:01:33.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19252024-12-18T20:01:33.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19262024-12-18T20:01:33.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19272024-12-18T20:01:33.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19282024-12-18T20:01:33.867ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
19292024-12-18T20:01:33.867ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 269.574494ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
19302024-12-18T20:01:33.882ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19312024-12-18T20:01:33.882ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19322024-12-18T20:01:33.882ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f86d10b-b0a0-445d-9c0e-9b2951cfcbbc", "content-length": "26", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
19332024-12-18T20:01:33.882ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19342024-12-18T20:01:33.885ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19352024-12-18T20:01:33.906ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19362024-12-18T20:01:33.956ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 359.315301ms iteration = 27 status = {}
19372024-12-18T20:01:33.973ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19382024-12-18T20:01:33.973ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19392024-12-18T20:01:33.973ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba8f1ea3-f678-4d82-8fa0-ed7683c4965d", "content-length": "372", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
19402024-12-18T20:01:33.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19412024-12-18T20:01:33.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19422024-12-18T20:01:34.024ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19432024-12-18T20:01:34.024ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0c42261-e0d6-4e4d-adbd-3443675c427e", "content-length": "691", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
19442024-12-18T20:01:34.024ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
19452024-12-18T20:01:34.024ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
19462024-12-18T20:01:34.024ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
19472024-12-18T20:01:34.026ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 428.543264ms iteration = 28 status = {}
19482024-12-18T20:01:34.031ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
19492024-12-18T20:01:34.031ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19502024-12-18T20:01:34.031ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "51224c4c-8ede-4de0-a0b3-9b27c96dad5f", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
19512024-12-18T20:01:34.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19522024-12-18T20:01:34.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19532024-12-18T20:01:34.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19542024-12-18T20:01:34.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19552024-12-18T20:01:34.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19562024-12-18T20:01:34.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19572024-12-18T20:01:34.038ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19582024-12-18T20:01:34.038ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b531380e-bec4-48d8-af72-49afb0fd6b8f", "content-length": "2", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
19592024-12-18T20:01:34.040ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19602024-12-18T20:01:34.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19612024-12-18T20:01:34.041ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19622024-12-18T20:01:34.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19632024-12-18T20:01:34.042ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "03816ebe-6ca4-4ae0-9c0f-873a19b97c47", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
19642024-12-18T20:01:34.043ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 446.260159ms iteration = 27 status = null
19652024-12-18T20:01:34.043ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 446.094585ms iteration = 29 status = {}
19662024-12-18T20:01:34.048ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 zone_address = fd00:1122:3344:101::2
19672024-12-18T20:01:34.048ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19682024-12-18T20:01:34.049ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b0c9f5a-9cb7-4db9-848b-622727216f88", "content-length": "26", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
19692024-12-18T20:01:34.049ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19702024-12-18T20:01:34.051ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
19712024-12-18T20:01:34.059ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
19722024-12-18T20:01:34.060ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e368901a-b30c-4112-a350-e0045bff09ac", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19732024-12-18T20:01:34.060ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19742024-12-18T20:01:34.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1465cdc2-5247-4670-8ded-dedf194604e5", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19752024-12-18T20:01:34.062ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19762024-12-18T20:01:34.062ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
19772024-12-18T20:01:34.063ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19782024-12-18T20:01:34.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 466.516225ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
19792024-12-18T20:01:34.120ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
19802024-12-18T20:01:34.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a1db55f9-07a0-4737-805a-e12c91c9bac2", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
19812024-12-18T20:01:34.121ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
19822024-12-18T20:01:34.123ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "456ff8ce-9e8b-4b5a-b1cc-e5bc7a4b1bc7", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
19832024-12-18T20:01:34.123ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
19842024-12-18T20:01:34.125ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "18e12725-e8a7-4eb3-9f87-02b0b09621d7", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
19852024-12-18T20:01:34.125ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
19862024-12-18T20:01:34.127ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
19872024-12-18T20:01:34.127ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 530.260757ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
19882024-12-18T20:01:34.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19892024-12-18T20:01:34.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19902024-12-18T20:01:34.177ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c592ee00-6719-4702-903e-a4aee00a8af1, rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(37c692d6-efbe-4d30-b3c8-683fe7cd5daa) } rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
19912024-12-18T20:01:34.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19922024-12-18T20:01:34.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19932024-12-18T20:01:34.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
19942024-12-18T20:01:34.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bd63c1b-61a4-42f9-97c5-61a69c6b6b3b", "content-length": "134", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
19952024-12-18T20:01:34.188ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
19962024-12-18T20:01:34.188ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 37c692d6-efbe-4d30-b3c8-683fe7cd5daa
19972024-12-18T20:01:34.188ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
19982024-12-18T20:01:34.188ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19992024-12-18T20:01:34.188ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20002024-12-18T20:01:34.188ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20012024-12-18T20:01:34.188ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20022024-12-18T20:01:34.188ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20032024-12-18T20:01:34.189ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20042024-12-18T20:01:34.189ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20052024-12-18T20:01:34.189ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
20062024-12-18T20:01:34.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20072024-12-18T20:01:34.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20082024-12-18T20:01:34.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20092024-12-18T20:01:34.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "52bb2c2c-5c64-4848-b475-812ffd4826e2", "content-length": "2", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
20102024-12-18T20:01:34.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20112024-12-18T20:01:34.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2ac2130-a1f5-423c-baa2-cbaba8f0d63f", "content-length": "52", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
20122024-12-18T20:01:34.191ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
20132024-12-18T20:01:34.191ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20142024-12-18T20:01:34.288ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "63b1398c-0450-443c-92e3-fd1260bfa87f", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
20152024-12-18T20:01:34.288ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch = Switch0
20162024-12-18T20:01:34.288ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20172024-12-18T20:01:34.288ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "744a5a9f-7503-4edf-bd24-29f47eac3b90", "content-length": "682", "date": "Wed, 18 Dec 2024 20:01:33 GMT"} })
20182024-12-18T20:01:34.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20192024-12-18T20:01:34.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20202024-12-18T20:01:34.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20212024-12-18T20:01:34.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20222024-12-18T20:01:34.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20232024-12-18T20:01:34.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20242024-12-18T20:01:34.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20252024-12-18T20:01:34.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20262024-12-18T20:01:34.307ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 710.137367ms iteration = 27 status = {}
20272024-12-18T20:01:34.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b71c009c-ec53-44ed-aed0-89b0822b0386 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20282024-12-18T20:01:34.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b71c009c-ec53-44ed-aed0-89b0822b0386 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20292024-12-18T20:01:34.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b71c009c-ec53-44ed-aed0-89b0822b0386 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20302024-12-18T20:01:34.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1226 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 9562073a-44bc-4734-836e-efb94f2fa844 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
20312024-12-18T20:01:35.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 380b9200-c457-4b06-b1f7-eca394be4076 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20322024-12-18T20:01:35.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 380b9200-c457-4b06-b1f7-eca394be4076 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20332024-12-18T20:01:35.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 380b9200-c457-4b06-b1f7-eca394be4076 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20342024-12-18T20:01:36.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 82d5859d-e766-40e8-a7b1-02b2d4241ea1 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20352024-12-18T20:01:36.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 82d5859d-e766-40e8-a7b1-02b2d4241ea1 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20362024-12-18T20:01:36.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 82d5859d-e766-40e8-a7b1-02b2d4241ea1 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20372024-12-18T20:01:37.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 95cec0c0-0682-4f07-8d91-d56d66055394 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20382024-12-18T20:01:37.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 95cec0c0-0682-4f07-8d91-d56d66055394 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20392024-12-18T20:01:37.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 95cec0c0-0682-4f07-8d91-d56d66055394 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20402024-12-18T20:01:38.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 25cc7cb0-11c1-4561-becd-84ab2268caa5 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20412024-12-18T20:01:38.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 25cc7cb0-11c1-4561-becd-84ab2268caa5 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20422024-12-18T20:01:38.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 25cc7cb0-11c1-4561-becd-84ab2268caa5 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20432024-12-18T20:01:39.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ba5d1e70-d2c3-48bf-a07b-8839e194d993 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20442024-12-18T20:01:39.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ba5d1e70-d2c3-48bf-a07b-8839e194d993 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20452024-12-18T20:01:39.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ba5d1e70-d2c3-48bf-a07b-8839e194d993 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20462024-12-18T20:01:40.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9fd34555-ba7b-4b29-a5d7-f84ef18ecb69 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20472024-12-18T20:01:40.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9fd34555-ba7b-4b29-a5d7-f84ef18ecb69 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20482024-12-18T20:01:40.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9fd34555-ba7b-4b29-a5d7-f84ef18ecb69 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20492024-12-18T20:01:41.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e7b055da-012d-4338-987e-ef6845ab3c22 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20502024-12-18T20:01:41.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e7b055da-012d-4338-987e-ef6845ab3c22 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20512024-12-18T20:01:41.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e7b055da-012d-4338-987e-ef6845ab3c22 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20522024-12-18T20:01:42.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 44e23cdd-ef0e-4640-9abd-1bb34a4864fa roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20532024-12-18T20:01:42.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 44e23cdd-ef0e-4640-9abd-1bb34a4864fa resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20542024-12-18T20:01:42.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 44e23cdd-ef0e-4640-9abd-1bb34a4864fa response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20552024-12-18T20:01:43.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
20562024-12-18T20:01:43.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20572024-12-18T20:01:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20582024-12-18T20:01:43.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
20592024-12-18T20:01:43.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20602024-12-18T20:01:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20612024-12-18T20:01:43.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20622024-12-18T20:01:43.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20632024-12-18T20:01:43.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.164952ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20642024-12-18T20:01:43.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20652024-12-18T20:01:43.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20662024-12-18T20:01:43.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20672024-12-18T20:01:43.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20682024-12-18T20:01:43.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20692024-12-18T20:01:43.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20702024-12-18T20:01:43.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20712024-12-18T20:01:43.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
20722024-12-18T20:01:43.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20732024-12-18T20:01:43.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20742024-12-18T20:01:43.667ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
20752024-12-18T20:01:43.667ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.372957ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
20762024-12-18T20:01:43.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 58d2a0f6-4f0f-4f10-84eb-5d82d18287d8 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20772024-12-18T20:01:43.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 58d2a0f6-4f0f-4f10-84eb-5d82d18287d8 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20782024-12-18T20:01:43.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 58d2a0f6-4f0f-4f10-84eb-5d82d18287d8 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20792024-12-18T20:01:44.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1285 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 765492af-4bf7-4054-b89e-8f72195ab408 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
20802024-12-18T20:01:44.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 22a76176-477e-49d8-b662-621c63d9d518 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20812024-12-18T20:01:44.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 22a76176-477e-49d8-b662-621c63d9d518 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20822024-12-18T20:01:44.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 22a76176-477e-49d8-b662-621c63d9d518 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20832024-12-18T20:01:45.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ec344823-f940-4a7d-a97e-4cd4d6e11b59 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20842024-12-18T20:01:45.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ec344823-f940-4a7d-a97e-4cd4d6e11b59 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20852024-12-18T20:01:45.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ec344823-f940-4a7d-a97e-4cd4d6e11b59 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20862024-12-18T20:01:46.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a656b017-1ede-4bb3-bdd0-29aee3a141b7 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20872024-12-18T20:01:46.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a656b017-1ede-4bb3-bdd0-29aee3a141b7 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20882024-12-18T20:01:46.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a656b017-1ede-4bb3-bdd0-29aee3a141b7 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20892024-12-18T20:01:47.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 474f768a-efc2-4c3a-a9ee-fa7445098d43 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20902024-12-18T20:01:47.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 474f768a-efc2-4c3a-a9ee-fa7445098d43 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20912024-12-18T20:01:47.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 474f768a-efc2-4c3a-a9ee-fa7445098d43 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20922024-12-18T20:01:48.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0ac53f59-a532-4edc-a07c-20273113f3da roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20932024-12-18T20:01:48.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0ac53f59-a532-4edc-a07c-20273113f3da resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20942024-12-18T20:01:48.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0ac53f59-a532-4edc-a07c-20273113f3da response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20952024-12-18T20:01:49.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f08e8357-c950-4784-bac1-a6ebbc1483d9 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20962024-12-18T20:01:49.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f08e8357-c950-4784-bac1-a6ebbc1483d9 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20972024-12-18T20:01:49.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f08e8357-c950-4784-bac1-a6ebbc1483d9 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20982024-12-18T20:01:50.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 186980ba-a526-44cb-9d08-64a506b40c34 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
20992024-12-18T20:01:50.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 186980ba-a526-44cb-9d08-64a506b40c34 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21002024-12-18T20:01:50.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 186980ba-a526-44cb-9d08-64a506b40c34 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21012024-12-18T20:01:51.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0b1e51fa-f312-484b-b675-ffdea48f80e8 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21022024-12-18T20:01:51.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0b1e51fa-f312-484b-b675-ffdea48f80e8 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21032024-12-18T20:01:51.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0b1e51fa-f312-484b-b675-ffdea48f80e8 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21042024-12-18T20:01:52.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ddcc0b5c-18ef-4a62-bff3-b3cc66e5c7d1 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21052024-12-18T20:01:52.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ddcc0b5c-18ef-4a62-bff3-b3cc66e5c7d1 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21062024-12-18T20:01:52.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ddcc0b5c-18ef-4a62-bff3-b3cc66e5c7d1 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21072024-12-18T20:01:53.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
21082024-12-18T20:01:53.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21092024-12-18T20:01:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21102024-12-18T20:01:53.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
21112024-12-18T20:01:53.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21122024-12-18T20:01:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21132024-12-18T20:01:53.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21142024-12-18T20:01:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21152024-12-18T20:01:53.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21162024-12-18T20:01:53.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21172024-12-18T20:01:53.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21182024-12-18T20:01:53.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21192024-12-18T20:01:53.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.028795ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21202024-12-18T20:01:53.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21212024-12-18T20:01:53.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21222024-12-18T20:01:53.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21232024-12-18T20:01:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
21242024-12-18T20:01:53.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21252024-12-18T20:01:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21262024-12-18T20:01:53.658ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
21272024-12-18T20:01:53.658ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.388052ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
21282024-12-18T20:01:53.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f97d0bb2-76d1-4641-8edf-3796317c33fe roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21292024-12-18T20:01:53.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f97d0bb2-76d1-4641-8edf-3796317c33fe resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21302024-12-18T20:01:53.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f97d0bb2-76d1-4641-8edf-3796317c33fe response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21312024-12-18T20:01:54.562ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1418 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = ad588ec8-c90c-4f72-92e7-02f77e5414d0 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
21322024-12-18T20:01:54.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3569ca09-ed66-4aa0-847e-55f3ec8274b7 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21332024-12-18T20:01:54.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3569ca09-ed66-4aa0-847e-55f3ec8274b7 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21342024-12-18T20:01:54.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3569ca09-ed66-4aa0-847e-55f3ec8274b7 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21352024-12-18T20:01:55.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 27768b15-d918-4719-9899-85d83e24898f roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21362024-12-18T20:01:55.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 27768b15-d918-4719-9899-85d83e24898f resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21372024-12-18T20:01:55.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 27768b15-d918-4719-9899-85d83e24898f response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21382024-12-18T20:01:56.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 300bdb80-e162-4d70-b367-c9fbff31e6b8 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21392024-12-18T20:01:56.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 300bdb80-e162-4d70-b367-c9fbff31e6b8 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21402024-12-18T20:01:56.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 300bdb80-e162-4d70-b367-c9fbff31e6b8 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21412024-12-18T20:01:58.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 546b9faf-3d30-43f7-b4bf-a4738140a7a8 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21422024-12-18T20:01:58.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 546b9faf-3d30-43f7-b4bf-a4738140a7a8 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21432024-12-18T20:01:58.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 546b9faf-3d30-43f7-b4bf-a4738140a7a8 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21442024-12-18T20:01:59.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e7e407d1-107f-4ac2-a2cb-5b2287e65382 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21452024-12-18T20:01:59.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e7e407d1-107f-4ac2-a2cb-5b2287e65382 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21462024-12-18T20:01:59.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e7e407d1-107f-4ac2-a2cb-5b2287e65382 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21472024-12-18T20:01:59.168ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:62162
21482024-12-18T20:01:59.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62162 req_id = f8358a18-9c5c-467b-8448-5f402625240f roles = RoleSet { roles: {} } uri = /metrics/producers
21492024-12-18T20:01:59.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62162 req_id = f8358a18-9c5c-467b-8448-5f402625240f resource = Database result = Ok(()) uri = /metrics/producers
21502024-12-18T20:01:59.226ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = 6e435600-9709-41f3-aa5a-2e4931ba547c
21512024-12-18T20:01:59.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58710 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62162 req_id = f8358a18-9c5c-467b-8448-5f402625240f response_code = 201 uri = /metrics/producers
21522024-12-18T20:02:00.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = eb814071-6704-4c25-81a1-f651cb654f22 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21532024-12-18T20:02:00.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = eb814071-6704-4c25-81a1-f651cb654f22 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21542024-12-18T20:02:00.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = eb814071-6704-4c25-81a1-f651cb654f22 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21552024-12-18T20:02:01.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b07aea6f-4123-49f7-9954-b4b17c57ca26 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21562024-12-18T20:02:01.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b07aea6f-4123-49f7-9954-b4b17c57ca26 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21572024-12-18T20:02:01.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b07aea6f-4123-49f7-9954-b4b17c57ca26 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21582024-12-18T20:02:01.656ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:32924
21592024-12-18T20:02:01.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32924 req_id = 7f037384-5254-40b8-a090-c4679663df3c roles = RoleSet { roles: {} } uri = /metrics/producers
21602024-12-18T20:02:01.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32924 req_id = 7f037384-5254-40b8-a090-c4679663df3c resource = Database result = Ok(()) uri = /metrics/producers
21612024-12-18T20:02:01.707ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = bcbd5f8a-f91b-41ec-b246-0f9965a43b42
21622024-12-18T20:02:01.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51142 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32924 req_id = 7f037384-5254-40b8-a090-c4679663df3c response_code = 201 uri = /metrics/producers
21632024-12-18T20:02:02.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6639c2cd-9d54-4323-b894-a582702f335e roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21642024-12-18T20:02:02.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6639c2cd-9d54-4323-b894-a582702f335e resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21652024-12-18T20:02:02.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6639c2cd-9d54-4323-b894-a582702f335e response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21662024-12-18T20:02:03.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7eed5bdb-9ac0-4876-aae2-1e690c8eb135 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21672024-12-18T20:02:03.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7eed5bdb-9ac0-4876-aae2-1e690c8eb135 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21682024-12-18T20:02:03.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7eed5bdb-9ac0-4876-aae2-1e690c8eb135 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
21692024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
21702024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21712024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
21722024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
21732024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21742024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
21752024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21762024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21772024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21782024-12-18T20:02:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21792024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
21802024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
21812024-12-18T20:02:03.598ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
21822024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21832024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21842024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
21852024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21862024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
21872024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
21882024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21892024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21902024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
21912024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
21922024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21932024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21942024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
21952024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21962024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
21972024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21982024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
21992024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22002024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
22012024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
22022024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22032024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22042024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22052024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
22062024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22072024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22082024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22092024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22102024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22112024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22122024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22132024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22142024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22152024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22162024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22172024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22182024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22192024-12-18T20:02:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22202024-12-18T20:02:03.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22212024-12-18T20:02:03.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1798, tv_nsec: 887747080 } })
22222024-12-18T20:02:03.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
22232024-12-18T20:02:03.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22242024-12-18T20:02:03.601ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.35844ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22252024-12-18T20:02:03.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1798, tv_nsec: 888958855 } })
22262024-12-18T20:02:03.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
22272024-12-18T20:02:03.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22282024-12-18T20:02:03.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22292024-12-18T20:02:03.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22302024-12-18T20:02:03.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22312024-12-18T20:02:03.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22322024-12-18T20:02:03.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22332024-12-18T20:02:03.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22342024-12-18T20:02:03.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.044566ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
22352024-12-18T20:02:03.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22362024-12-18T20:02:03.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22372024-12-18T20:02:03.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22382024-12-18T20:02:03.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22392024-12-18T20:02:03.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22402024-12-18T20:02:03.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22412024-12-18T20:02:03.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22422024-12-18T20:02:03.646ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
22432024-12-18T20:02:03.646ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22442024-12-18T20:02:03.646ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bebd104-6385-4786-8b2a-f8bd978b51d6", "content-length": "26", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
22452024-12-18T20:02:03.646ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22462024-12-18T20:02:03.648ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
22472024-12-18T20:02:03.648ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22482024-12-18T20:02:03.649ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a42143e0-f9cd-47b2-a81a-5d5dfce66fba", "content-length": "26", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
22492024-12-18T20:02:03.649ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22502024-12-18T20:02:03.649ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22512024-12-18T20:02:03.650ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22522024-12-18T20:02:03.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22532024-12-18T20:02:03.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22542024-12-18T20:02:03.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22552024-12-18T20:02:03.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22562024-12-18T20:02:03.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.621661ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
22572024-12-18T20:02:03.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22582024-12-18T20:02:03.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22592024-12-18T20:02:03.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22602024-12-18T20:02:03.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22612024-12-18T20:02:03.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22622024-12-18T20:02:03.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22632024-12-18T20:02:03.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22642024-12-18T20:02:03.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22652024-12-18T20:02:03.673ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22662024-12-18T20:02:03.673ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22672024-12-18T20:02:03.673ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22682024-12-18T20:02:03.673ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22692024-12-18T20:02:03.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22702024-12-18T20:02:03.673ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22712024-12-18T20:02:03.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22722024-12-18T20:02:03.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22732024-12-18T20:02:03.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22742024-12-18T20:02:03.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22752024-12-18T20:02:03.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22762024-12-18T20:02:03.675ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22772024-12-18T20:02:03.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22782024-12-18T20:02:03.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22792024-12-18T20:02:03.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
22802024-12-18T20:02:03.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22812024-12-18T20:02:03.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22822024-12-18T20:02:03.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22832024-12-18T20:02:03.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22842024-12-18T20:02:03.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22852024-12-18T20:02:03.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22862024-12-18T20:02:03.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22872024-12-18T20:02:03.679ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1798, tv_nsec: 966641202 } })
22882024-12-18T20:02:03.679ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
22892024-12-18T20:02:03.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22902024-12-18T20:02:03.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22912024-12-18T20:02:03.686ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22922024-12-18T20:02:03.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22932024-12-18T20:02:03.695ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
22942024-12-18T20:02:03.695ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.964735ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
22952024-12-18T20:02:03.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 125.177435ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22962024-12-18T20:02:03.725ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 127.826889ms iteration = 28 status = {}
22972024-12-18T20:02:03.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22982024-12-18T20:02:03.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22992024-12-18T20:02:03.740ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 141.811156ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23002024-12-18T20:02:03.741ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23012024-12-18T20:02:03.741ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23022024-12-18T20:02:03.741ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23032024-12-18T20:02:03.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23042024-12-18T20:02:03.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 146.546054ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23052024-12-18T20:02:03.745ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062024-12-18T20:02:03.747ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23072024-12-18T20:02:03.747ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "153bd6f6-e158-4476-b40c-1e5596362d30", "content-length": "2", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23082024-12-18T20:02:03.749ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23092024-12-18T20:02:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23102024-12-18T20:02:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
23112024-12-18T20:02:03.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23122024-12-18T20:02:03.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23132024-12-18T20:02:03.751ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23142024-12-18T20:02:03.751ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 152.822354ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23152024-12-18T20:02:03.752ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 155.61565ms iteration = 28 status = null
23162024-12-18T20:02:03.753ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 154.939377ms iteration = 28 status = 0
23172024-12-18T20:02:03.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 zone_address = fd00:1122:3344:101::2
23182024-12-18T20:02:03.762ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23192024-12-18T20:02:03.762ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1707e0c-385f-4307-a7f1-80d1f389ad8f", "content-length": "26", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23202024-12-18T20:02:03.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23212024-12-18T20:02:03.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
23222024-12-18T20:02:03.787ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23232024-12-18T20:02:03.787ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23242024-12-18T20:02:03.787ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 188.775793ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23252024-12-18T20:02:03.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23262024-12-18T20:02:03.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23272024-12-18T20:02:03.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23282024-12-18T20:02:03.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 195.672345ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
23292024-12-18T20:02:03.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23302024-12-18T20:02:03.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23312024-12-18T20:02:03.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23322024-12-18T20:02:03.851ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23332024-12-18T20:02:03.851ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23342024-12-18T20:02:03.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23352024-12-18T20:02:03.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23362024-12-18T20:02:03.892ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c592ee00-6719-4702-903e-a4aee00a8af1, rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(37c692d6-efbe-4d30-b3c8-683fe7cd5daa) } rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
23372024-12-18T20:02:03.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23382024-12-18T20:02:03.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23392024-12-18T20:02:03.902ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23402024-12-18T20:02:03.903ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "73c0cb3f-e131-487e-a011-39449e9088d7", "content-length": "134", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23412024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
23422024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 37c692d6-efbe-4d30-b3c8-683fe7cd5daa
23432024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
23442024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23452024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23462024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23472024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23482024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23492024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23502024-12-18T20:02:03.903ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23512024-12-18T20:02:03.904ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
23522024-12-18T20:02:03.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23532024-12-18T20:02:03.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23542024-12-18T20:02:03.907ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23552024-12-18T20:02:03.908ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b9e5247-c425-44dc-93d1-040974d29a3b", "content-length": "2", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23562024-12-18T20:02:03.908ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23572024-12-18T20:02:03.908ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "84f5e07d-12b2-4d06-b9da-37d7d4d677f2", "content-length": "52", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23582024-12-18T20:02:03.908ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
23592024-12-18T20:02:03.908ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23602024-12-18T20:02:03.924ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3774b41f-83ba-4789-b8ac-4ea263f397e8", "content-length": "372", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23612024-12-18T20:02:03.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23622024-12-18T20:02:03.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23632024-12-18T20:02:03.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23642024-12-18T20:02:03.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23652024-12-18T20:02:03.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23662024-12-18T20:02:03.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23672024-12-18T20:02:03.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23682024-12-18T20:02:03.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23692024-12-18T20:02:03.942ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 343.704129ms iteration = 32 status = {"physical_disks_added":0}
23702024-12-18T20:02:03.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23712024-12-18T20:02:03.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23722024-12-18T20:02:03.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23732024-12-18T20:02:03.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23742024-12-18T20:02:03.989ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
23752024-12-18T20:02:03.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23762024-12-18T20:02:03.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9f495266-1175-4284-b96a-19340b6e4726", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23772024-12-18T20:02:03.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23782024-12-18T20:02:03.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23792024-12-18T20:02:03.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23802024-12-18T20:02:03.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23812024-12-18T20:02:03.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23822024-12-18T20:02:03.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23832024-12-18T20:02:03.999ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23842024-12-18T20:02:03.999ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23852024-12-18T20:02:04.000ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fd6767a4-7dc5-47c3-8ffb-a01451948721", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23862024-12-18T20:02:04.001ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 403.245974ms iteration = 30 status = {}
23872024-12-18T20:02:04.020ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23882024-12-18T20:02:04.025ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "616456e3-3dfb-49d3-8dee-992b98455adc", "content-length": "691", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23892024-12-18T20:02:04.025ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23902024-12-18T20:02:04.025ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23912024-12-18T20:02:04.025ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23922024-12-18T20:02:04.027ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 429.387211ms iteration = 29 status = {}
23932024-12-18T20:02:04.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2e58eee1-b1c3-4da8-983e-a5c9cf3de760", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23942024-12-18T20:02:04.033ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch = Switch0
23952024-12-18T20:02:04.033ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23962024-12-18T20:02:04.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "056e2c71-1cf6-4d0a-9a92-81c46f7df9b2", "content-length": "682", "date": "Wed, 18 Dec 2024 20:02:03 GMT"} })
23972024-12-18T20:02:04.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23982024-12-18T20:02:04.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23992024-12-18T20:02:04.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24002024-12-18T20:02:04.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24012024-12-18T20:02:04.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24022024-12-18T20:02:04.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24032024-12-18T20:02:04.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24042024-12-18T20:02:04.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24052024-12-18T20:02:04.053ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 455.019329ms iteration = 28 status = {}
24062024-12-18T20:02:04.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10cab5c5-dde1-4982-a7d4-a87348714c90 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24072024-12-18T20:02:04.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10cab5c5-dde1-4982-a7d4-a87348714c90 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24082024-12-18T20:02:04.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10cab5c5-dde1-4982-a7d4-a87348714c90 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24092024-12-18T20:02:04.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1288 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 99af9cd0-dd72-4446-84f1-972a4ade6253 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
24102024-12-18T20:02:05.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 73c3c81e-5d03-43ba-b4b5-6680b4b823a4 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24112024-12-18T20:02:05.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 73c3c81e-5d03-43ba-b4b5-6680b4b823a4 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24122024-12-18T20:02:05.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 73c3c81e-5d03-43ba-b4b5-6680b4b823a4 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24132024-12-18T20:02:06.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ecb5ab86-62f4-4905-afb4-72bc5941f09d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24142024-12-18T20:02:06.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ecb5ab86-62f4-4905-afb4-72bc5941f09d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24152024-12-18T20:02:06.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ecb5ab86-62f4-4905-afb4-72bc5941f09d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24162024-12-18T20:02:07.027ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48487
24172024-12-18T20:02:07.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48487 req_id = 526a0aca-4eee-4209-9a1c-fde520ed2aad roles = RoleSet { roles: {} } uri = /metrics/producers
24182024-12-18T20:02:07.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48487 req_id = 526a0aca-4eee-4209-9a1c-fde520ed2aad resource = Database result = Ok(()) uri = /metrics/producers
24192024-12-18T20:02:07.082ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = fc66dedb-5d92-4ef9-9195-7dfe0000c00a
24202024-12-18T20:02:07.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54946 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48487 req_id = 526a0aca-4eee-4209-9a1c-fde520ed2aad response_code = 201 uri = /metrics/producers
24212024-12-18T20:02:07.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d2893e2c-ec5e-445c-8cec-553ca665b718 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24222024-12-18T20:02:07.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d2893e2c-ec5e-445c-8cec-553ca665b718 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24232024-12-18T20:02:07.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d2893e2c-ec5e-445c-8cec-553ca665b718 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24242024-12-18T20:02:08.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 23748529-3d66-4929-a339-837e76e76412 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24252024-12-18T20:02:08.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 23748529-3d66-4929-a339-837e76e76412 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24262024-12-18T20:02:08.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 23748529-3d66-4929-a339-837e76e76412 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24272024-12-18T20:02:09.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c68df795-2017-4f83-a570-08fbc81e85ce roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24282024-12-18T20:02:09.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c68df795-2017-4f83-a570-08fbc81e85ce resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24292024-12-18T20:02:09.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c68df795-2017-4f83-a570-08fbc81e85ce response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24302024-12-18T20:02:10.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a8abf702-693d-459a-b480-85997799854a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24312024-12-18T20:02:10.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a8abf702-693d-459a-b480-85997799854a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24322024-12-18T20:02:10.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a8abf702-693d-459a-b480-85997799854a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24332024-12-18T20:02:11.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e32c2d6a-ab3f-4b58-9e61-f2157cf2d273 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24342024-12-18T20:02:11.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e32c2d6a-ab3f-4b58-9e61-f2157cf2d273 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24352024-12-18T20:02:11.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e32c2d6a-ab3f-4b58-9e61-f2157cf2d273 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24362024-12-18T20:02:12.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 003a53a9-d963-4d1b-83a6-ad4c993c4f31 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24372024-12-18T20:02:12.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 003a53a9-d963-4d1b-83a6-ad4c993c4f31 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24382024-12-18T20:02:12.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 003a53a9-d963-4d1b-83a6-ad4c993c4f31 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24392024-12-18T20:02:13.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6666a696-73c2-46ae-b95a-b0a8ed47fb17 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24402024-12-18T20:02:13.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6666a696-73c2-46ae-b95a-b0a8ed47fb17 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24412024-12-18T20:02:13.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6666a696-73c2-46ae-b95a-b0a8ed47fb17 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24422024-12-18T20:02:13.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
24432024-12-18T20:02:13.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24442024-12-18T20:02:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24452024-12-18T20:02:13.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
24462024-12-18T20:02:13.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24472024-12-18T20:02:13.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24482024-12-18T20:02:13.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24492024-12-18T20:02:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24502024-12-18T20:02:13.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24512024-12-18T20:02:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24522024-12-18T20:02:13.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24532024-12-18T20:02:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24542024-12-18T20:02:13.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24552024-12-18T20:02:13.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24562024-12-18T20:02:13.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24572024-12-18T20:02:13.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
24582024-12-18T20:02:13.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24592024-12-18T20:02:13.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24602024-12-18T20:02:13.660ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
24612024-12-18T20:02:13.660ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.744051ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
24622024-12-18T20:02:13.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.063979ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24632024-12-18T20:02:14.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f1b136c4-88d9-49b8-a382-2bf486e94f27 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24642024-12-18T20:02:14.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f1b136c4-88d9-49b8-a382-2bf486e94f27 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24652024-12-18T20:02:14.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f1b136c4-88d9-49b8-a382-2bf486e94f27 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24662024-12-18T20:02:14.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 214d5e29-0831-4828-ba33-bc019b620275 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
24672024-12-18T20:02:14.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 214d5e29-0831-4828-ba33-bc019b620275 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
24682024-12-18T20:02:14.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 214d5e29-0831-4828-ba33-bc019b620275 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
24692024-12-18T20:02:14.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 38a12a94-b762-4ffa-9559-47bea817b8b5 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
24702024-12-18T20:02:14.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 38a12a94-b762-4ffa-9559-47bea817b8b5 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
24712024-12-18T20:02:14.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 38a12a94-b762-4ffa-9559-47bea817b8b5 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
24722024-12-18T20:02:14.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1382 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 8698e2e6-fe1a-479c-8180-b729dde295c6 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
24732024-12-18T20:02:15.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c0d8aee1-a109-47b0-954f-a2b5ddc7cde0 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24742024-12-18T20:02:15.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c0d8aee1-a109-47b0-954f-a2b5ddc7cde0 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24752024-12-18T20:02:15.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c0d8aee1-a109-47b0-954f-a2b5ddc7cde0 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24762024-12-18T20:02:16.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b993ac23-da14-4747-ac6b-f46f3e59f48a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24772024-12-18T20:02:16.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b993ac23-da14-4747-ac6b-f46f3e59f48a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24782024-12-18T20:02:16.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b993ac23-da14-4747-ac6b-f46f3e59f48a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24792024-12-18T20:02:17.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 749caf6e-9598-4703-8f74-cc4b9f3d6249 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24802024-12-18T20:02:17.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 749caf6e-9598-4703-8f74-cc4b9f3d6249 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24812024-12-18T20:02:17.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 749caf6e-9598-4703-8f74-cc4b9f3d6249 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24822024-12-18T20:02:18.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fac6a894-e3a1-485c-8ebb-fb8174c021df roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24832024-12-18T20:02:18.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fac6a894-e3a1-485c-8ebb-fb8174c021df resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24842024-12-18T20:02:18.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = fac6a894-e3a1-485c-8ebb-fb8174c021df response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24852024-12-18T20:02:19.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ab62d238-7365-4760-a52f-047cf735f3dc roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24862024-12-18T20:02:19.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ab62d238-7365-4760-a52f-047cf735f3dc resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24872024-12-18T20:02:19.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ab62d238-7365-4760-a52f-047cf735f3dc response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24882024-12-18T20:02:20.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 37a685c0-bf69-4426-8250-3788430d7128 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24892024-12-18T20:02:20.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 37a685c0-bf69-4426-8250-3788430d7128 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24902024-12-18T20:02:20.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 37a685c0-bf69-4426-8250-3788430d7128 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24912024-12-18T20:02:21.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = df9d0929-e4bc-4566-8dd2-fe7f6180fc50 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24922024-12-18T20:02:21.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = df9d0929-e4bc-4566-8dd2-fe7f6180fc50 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24932024-12-18T20:02:21.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = df9d0929-e4bc-4566-8dd2-fe7f6180fc50 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24942024-12-18T20:02:22.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6d568b72-886b-4fa8-bb54-9f4a502d39cc roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24952024-12-18T20:02:22.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6d568b72-886b-4fa8-bb54-9f4a502d39cc resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24962024-12-18T20:02:22.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6d568b72-886b-4fa8-bb54-9f4a502d39cc response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24972024-12-18T20:02:23.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2891b64e-7026-47f4-8d65-b809ee1dcffc roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24982024-12-18T20:02:23.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2891b64e-7026-47f4-8d65-b809ee1dcffc resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
24992024-12-18T20:02:23.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2891b64e-7026-47f4-8d65-b809ee1dcffc response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25002024-12-18T20:02:23.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
25012024-12-18T20:02:23.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25022024-12-18T20:02:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25032024-12-18T20:02:23.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
25042024-12-18T20:02:23.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25052024-12-18T20:02:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25062024-12-18T20:02:23.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25072024-12-18T20:02:23.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25082024-12-18T20:02:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25092024-12-18T20:02:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25102024-12-18T20:02:23.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25112024-12-18T20:02:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25122024-12-18T20:02:23.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25132024-12-18T20:02:23.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25142024-12-18T20:02:23.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25152024-12-18T20:02:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
25162024-12-18T20:02:23.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25172024-12-18T20:02:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25182024-12-18T20:02:23.617ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
25192024-12-18T20:02:23.617ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.668665ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
25202024-12-18T20:02:23.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.56065ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25212024-12-18T20:02:24.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1430 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = e5ad2814-2530-40c5-8c08-3a9c30dd0bff response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
25222024-12-18T20:02:24.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5b4cbd44-84f1-4f0a-89b1-42505e5f3e28 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25232024-12-18T20:02:24.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5b4cbd44-84f1-4f0a-89b1-42505e5f3e28 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25242024-12-18T20:02:24.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5b4cbd44-84f1-4f0a-89b1-42505e5f3e28 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25252024-12-18T20:02:25.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5f2bd3a9-42fa-428c-ba34-26ffa03ecb6a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25262024-12-18T20:02:25.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5f2bd3a9-42fa-428c-ba34-26ffa03ecb6a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25272024-12-18T20:02:25.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5f2bd3a9-42fa-428c-ba34-26ffa03ecb6a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25282024-12-18T20:02:26.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c49a3dbb-7018-4ab5-9383-ebd60cd53e1c roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25292024-12-18T20:02:26.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c49a3dbb-7018-4ab5-9383-ebd60cd53e1c resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25302024-12-18T20:02:26.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c49a3dbb-7018-4ab5-9383-ebd60cd53e1c response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25312024-12-18T20:02:27.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a126bb5e-f825-4ca4-8332-a18e89256318 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25322024-12-18T20:02:27.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a126bb5e-f825-4ca4-8332-a18e89256318 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25332024-12-18T20:02:27.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a126bb5e-f825-4ca4-8332-a18e89256318 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25342024-12-18T20:02:28.632ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55332
25352024-12-18T20:02:28.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55332 req_id = 15c25e6d-0f40-492b-ad93-2743f6b0765c roles = RoleSet { roles: {} } uri = /metrics/producers
25362024-12-18T20:02:28.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55332 req_id = 15c25e6d-0f40-492b-ad93-2743f6b0765c resource = Database result = Ok(()) uri = /metrics/producers
25372024-12-18T20:02:28.684ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = 4ca4d550-d758-4bca-986a-beaa3869660c
25382024-12-18T20:02:28.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51371 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55332 req_id = 15c25e6d-0f40-492b-ad93-2743f6b0765c response_code = 201 uri = /metrics/producers
25392024-12-18T20:02:28.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 79fba7ac-5722-46f5-b2b2-5d53f39c7048 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25402024-12-18T20:02:28.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 79fba7ac-5722-46f5-b2b2-5d53f39c7048 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25412024-12-18T20:02:28.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 79fba7ac-5722-46f5-b2b2-5d53f39c7048 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25422024-12-18T20:02:29.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 99519a89-c319-4fe4-ab71-588db8665753 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
25432024-12-18T20:02:29.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 99519a89-c319-4fe4-ab71-588db8665753 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
25442024-12-18T20:02:29.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 99519a89-c319-4fe4-ab71-588db8665753 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
25452024-12-18T20:02:29.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = d9e608bd-3959-4997-9f18-afb63b1e30e2 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
25462024-12-18T20:02:29.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = d9e608bd-3959-4997-9f18-afb63b1e30e2 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
25472024-12-18T20:02:29.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = d9e608bd-3959-4997-9f18-afb63b1e30e2 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
25482024-12-18T20:02:29.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9268bc70-909b-4996-821f-fc5b130dfcdb roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25492024-12-18T20:02:29.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9268bc70-909b-4996-821f-fc5b130dfcdb resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25502024-12-18T20:02:29.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9268bc70-909b-4996-821f-fc5b130dfcdb response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25512024-12-18T20:02:30.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6847685c-fa5c-4b78-bf5c-ea8363f4081a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25522024-12-18T20:02:30.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6847685c-fa5c-4b78-bf5c-ea8363f4081a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25532024-12-18T20:02:30.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6847685c-fa5c-4b78-bf5c-ea8363f4081a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25542024-12-18T20:02:31.129ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52918
25552024-12-18T20:02:31.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52918 req_id = 7a45aadf-c3d8-4f31-904f-4e014ea2c2ea roles = RoleSet { roles: {} } uri = /metrics/producers
25562024-12-18T20:02:31.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52918 req_id = 7a45aadf-c3d8-4f31-904f-4e014ea2c2ea resource = Database result = Ok(()) uri = /metrics/producers
25572024-12-18T20:02:31.181ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = 58ee29db-9185-4216-97e8-559d204ec1d2
25582024-12-18T20:02:31.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51859 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52918 req_id = 7a45aadf-c3d8-4f31-904f-4e014ea2c2ea response_code = 201 uri = /metrics/producers
25592024-12-18T20:02:31.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 09a03ad0-787c-475f-ad2b-d136acc5fafb roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25602024-12-18T20:02:31.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 09a03ad0-787c-475f-ad2b-d136acc5fafb resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25612024-12-18T20:02:31.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 09a03ad0-787c-475f-ad2b-d136acc5fafb response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25622024-12-18T20:02:32.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8c681f2d-70c7-4f5c-99f1-49988277db90 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25632024-12-18T20:02:32.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8c681f2d-70c7-4f5c-99f1-49988277db90 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25642024-12-18T20:02:32.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8c681f2d-70c7-4f5c-99f1-49988277db90 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
25652024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
25662024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
25672024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
25682024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
25692024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
25702024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25712024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
25722024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
25732024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25742024-12-18T20:02:33.597ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 19:52:33.597238413 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
25752024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
25762024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
25772024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
25782024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25792024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
25802024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
25812024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25822024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
25832024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
25842024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
25852024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25862024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25872024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
25882024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
25892024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25902024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25912024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
25922024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25932024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
25942024-12-18T20:02:33.597ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66
25952024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.33\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66"}
25962024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
25972024-12-18T20:02:33.597ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
25982024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
25992024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26002024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
26012024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26022024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
26032024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26042024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26052024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
26062024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26072024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
26082024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26092024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
26102024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26112024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
26122024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26132024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
26142024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
26152024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26162024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
26172024-12-18T20:02:33.597ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26182024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26192024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
26202024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26212024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
26222024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26232024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
26242024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
26252024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
26262024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26272024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26282024-12-18T20:02:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
26292024-12-18T20:02:33.597ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e3d8b46-b399-4d3c-bc66-63409f4abd06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9da4e3ea-a57c-4b2b-81c3-7f374155d667.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9da4e3ea-a57c-4b2b-81c3-7f374155d667.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1828, tv_nsec: 885318449 } })
26302024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26312024-12-18T20:02:33.598ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73c17a86-f1fb-4102-92b8-0059f9ce4d77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89d5399b-5669-48fc-9549-d301f3010160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("967a5ab6-9437-47ac-b51c-7113605783e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("967a5ab6-9437-47ac-b51c-7113605783e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1828, tv_nsec: 885345419 } })
26322024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26332024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26342024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26352024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26362024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26372024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26382024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26392024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26402024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26412024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26422024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26432024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26442024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26452024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26462024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26472024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26482024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26492024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
26502024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26512024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26522024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
26532024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
26542024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.346018ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
26552024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
26562024-12-18T20:02:33.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.428359ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
26572024-12-18T20:02:33.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26582024-12-18T20:02:33.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26592024-12-18T20:02:33.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26602024-12-18T20:02:33.600ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 19:52:33.597238413 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
26612024-12-18T20:02:33.600ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.640525ms iteration = 15 status = {"expiration":"2024-12-18T19:52:33.597238413Z","pruned":[]}
26622024-12-18T20:02:33.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26632024-12-18T20:02:33.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1828, tv_nsec: 888836391 } })
26642024-12-18T20:02:33.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
26652024-12-18T20:02:33.602ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.917381ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26662024-12-18T20:02:33.603ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1828, tv_nsec: 890486745 } })
26672024-12-18T20:02:33.603ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
26682024-12-18T20:02:33.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26692024-12-18T20:02:33.606ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26702024-12-18T20:02:33.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26712024-12-18T20:02:33.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26722024-12-18T20:02:33.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26732024-12-18T20:02:33.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26742024-12-18T20:02:33.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
26752024-12-18T20:02:33.609ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26762024-12-18T20:02:33.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26772024-12-18T20:02:33.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26782024-12-18T20:02:33.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26792024-12-18T20:02:33.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26802024-12-18T20:02:33.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.193482ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
26812024-12-18T20:02:33.616ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.533751ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
26822024-12-18T20:02:33.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26832024-12-18T20:02:33.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26842024-12-18T20:02:33.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26852024-12-18T20:02:33.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26862024-12-18T20:02:33.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26872024-12-18T20:02:33.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26882024-12-18T20:02:33.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26892024-12-18T20:02:33.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26902024-12-18T20:02:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26912024-12-18T20:02:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26922024-12-18T20:02:33.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26932024-12-18T20:02:33.627ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1828, tv_nsec: 915302336 } })
26942024-12-18T20:02:33.628ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
26952024-12-18T20:02:33.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26962024-12-18T20:02:33.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26972024-12-18T20:02:33.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26982024-12-18T20:02:33.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26992024-12-18T20:02:33.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27002024-12-18T20:02:33.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27012024-12-18T20:02:33.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27022024-12-18T20:02:33.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 83.888666ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
27032024-12-18T20:02:33.683ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27042024-12-18T20:02:33.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27052024-12-18T20:02:33.687ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27062024-12-18T20:02:33.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27072024-12-18T20:02:33.691ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
27082024-12-18T20:02:33.691ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
27092024-12-18T20:02:33.691ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 93.527544ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
27102024-12-18T20:02:33.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27112024-12-18T20:02:33.693ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27122024-12-18T20:02:33.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27132024-12-18T20:02:33.694ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27142024-12-18T20:02:33.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27152024-12-18T20:02:33.695ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27162024-12-18T20:02:33.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27172024-12-18T20:02:33.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27182024-12-18T20:02:33.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27192024-12-18T20:02:33.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27202024-12-18T20:02:33.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27212024-12-18T20:02:33.697ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27222024-12-18T20:02:33.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27232024-12-18T20:02:33.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27242024-12-18T20:02:33.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27252024-12-18T20:02:33.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27262024-12-18T20:02:33.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27272024-12-18T20:02:33.704ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27282024-12-18T20:02:33.704ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27292024-12-18T20:02:33.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27302024-12-18T20:02:33.705ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27312024-12-18T20:02:33.705ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27322024-12-18T20:02:33.705ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27332024-12-18T20:02:33.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27342024-12-18T20:02:33.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27352024-12-18T20:02:33.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27362024-12-18T20:02:33.713ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
27372024-12-18T20:02:33.713ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
27382024-12-18T20:02:33.713ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.1805ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
27392024-12-18T20:02:33.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27402024-12-18T20:02:33.715ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
27412024-12-18T20:02:33.715ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
27422024-12-18T20:02:33.715ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
27432024-12-18T20:02:33.715ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27442024-12-18T20:02:33.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27452024-12-18T20:02:33.717ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27462024-12-18T20:02:33.717ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27472024-12-18T20:02:33.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27482024-12-18T20:02:33.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27492024-12-18T20:02:33.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
27502024-12-18T20:02:33.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27512024-12-18T20:02:33.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27522024-12-18T20:02:33.719ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27532024-12-18T20:02:33.719ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 121.686713ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27542024-12-18T20:02:33.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27552024-12-18T20:02:33.721ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27562024-12-18T20:02:33.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27572024-12-18T20:02:33.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27582024-12-18T20:02:33.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27592024-12-18T20:02:33.724ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27602024-12-18T20:02:33.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
27612024-12-18T20:02:33.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27622024-12-18T20:02:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27632024-12-18T20:02:33.728ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
27642024-12-18T20:02:33.728ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
27652024-12-18T20:02:33.728ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
27662024-12-18T20:02:33.728ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
27672024-12-18T20:02:33.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27682024-12-18T20:02:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27692024-12-18T20:02:33.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27702024-12-18T20:02:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27712024-12-18T20:02:33.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27722024-12-18T20:02:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27732024-12-18T20:02:33.739ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
27742024-12-18T20:02:33.739ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8fc962cf-e51f-448b-b0b6-3c8cab569201 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
27752024-12-18T20:02:33.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27762024-12-18T20:02:33.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27772024-12-18T20:02:33.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27782024-12-18T20:02:33.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
27792024-12-18T20:02:33.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 147.577276ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
27802024-12-18T20:02:33.746ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
27812024-12-18T20:02:33.746ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27822024-12-18T20:02:33.746ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9d2c145-0378-4607-9e08-c0d536940f0a", "content-length": "26", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
27832024-12-18T20:02:33.746ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27842024-12-18T20:02:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27852024-12-18T20:02:33.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27862024-12-18T20:02:33.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27872024-12-18T20:02:33.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27882024-12-18T20:02:33.750ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 153.234331ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27892024-12-18T20:02:33.750ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8fc962cf-e51f-448b-b0b6-3c8cab569201 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
27902024-12-18T20:02:33.750ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
27912024-12-18T20:02:33.750ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 19:48:33.465914 UTC dns_group = internal generation = 1
27922024-12-18T20:02:33.750ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 153.705731ms iteration = 16 status = {"generation":1}
27932024-12-18T20:02:33.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 162.979722ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27942024-12-18T20:02:33.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27952024-12-18T20:02:33.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 174.411607ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27962024-12-18T20:02:33.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
27972024-12-18T20:02:33.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27982024-12-18T20:02:33.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27992024-12-18T20:02:33.776ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 179.124164ms iteration = 29 status = 0
28002024-12-18T20:02:33.785ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28012024-12-18T20:02:33.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28022024-12-18T20:02:33.786ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28032024-12-18T20:02:33.786ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28042024-12-18T20:02:33.786ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28052024-12-18T20:02:33.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28062024-12-18T20:02:33.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28072024-12-18T20:02:33.793ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
28082024-12-18T20:02:33.793ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c5344268-eb33-4765-9d91-b9438861661e dns_zone_name = oxide.test found_so_far = 0 version = 2
28092024-12-18T20:02:33.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28102024-12-18T20:02:33.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28112024-12-18T20:02:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28122024-12-18T20:02:33.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28132024-12-18T20:02:33.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28142024-12-18T20:02:33.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28152024-12-18T20:02:33.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28162024-12-18T20:02:33.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b947986f-00cf-49aa-806a-85d74240c32b roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
28172024-12-18T20:02:33.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b947986f-00cf-49aa-806a-85d74240c32b resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
28182024-12-18T20:02:33.800ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28192024-12-18T20:02:33.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28202024-12-18T20:02:33.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28212024-12-18T20:02:33.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28222024-12-18T20:02:33.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 229.437748ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
28232024-12-18T20:02:33.886ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28242024-12-18T20:02:33.886ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28252024-12-18T20:02:33.886ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78053f5e-0c15-424a-989e-59ec094ac3cf", "content-length": "26", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
28262024-12-18T20:02:33.886ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28272024-12-18T20:02:33.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28282024-12-18T20:02:33.891ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 294.299954ms iteration = 29 status = {}
28292024-12-18T20:02:33.892ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 zone_address = fd00:1122:3344:101::2
28302024-12-18T20:02:33.892ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28312024-12-18T20:02:33.892ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c61bbbf3-1f6f-41c6-87d4-ec0482eb1164", "content-length": "26", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
28322024-12-18T20:02:33.893ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28332024-12-18T20:02:33.895ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
28342024-12-18T20:02:33.900ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
28352024-12-18T20:02:33.901ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e05b155b-1161-40f2-9245-02a38dc56555", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28362024-12-18T20:02:33.901ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28372024-12-18T20:02:33.902ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "30c2496f-1803-4256-b841-f74c541eed11", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28382024-12-18T20:02:33.902ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28392024-12-18T20:02:33.903ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
28402024-12-18T20:02:33.905ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28412024-12-18T20:02:33.905ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 307.887503ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
28422024-12-18T20:02:33.924ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28432024-12-18T20:02:33.924ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28442024-12-18T20:02:33.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28452024-12-18T20:02:33.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28462024-12-18T20:02:33.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28472024-12-18T20:02:33.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28482024-12-18T20:02:33.933ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28492024-12-18T20:02:33.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b947986f-00cf-49aa-806a-85d74240c32b response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
28502024-12-18T20:02:33.934ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 336.811168ms iteration = 33 status = {"physical_disks_added":0}
28512024-12-18T20:02:33.934ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c5344268-eb33-4765-9d91-b9438861661e dns_zone_name = oxide.test found_so_far = 1 version = 2
28522024-12-18T20:02:33.934ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
28532024-12-18T20:02:33.934ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 19:48:35.279811 UTC dns_group = external generation = 2
28542024-12-18T20:02:33.934ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 337.305747ms iteration = 16 status = {"generation":2}
28552024-12-18T20:02:33.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28562024-12-18T20:02:33.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28572024-12-18T20:02:33.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28582024-12-18T20:02:33.959ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c747c62-7993-4269-a392-eebb1c606a84", "content-length": "372", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
28592024-12-18T20:02:33.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28602024-12-18T20:02:33.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28612024-12-18T20:02:33.970ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28622024-12-18T20:02:33.970ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28632024-12-18T20:02:33.970ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 373.41894ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28642024-12-18T20:02:33.973ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28652024-12-18T20:02:33.973ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "889cdfad-b2f1-4e7d-8d5a-3a537dbf1b80", "content-length": "2", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
28662024-12-18T20:02:33.974ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
28672024-12-18T20:02:33.974ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28682024-12-18T20:02:33.975ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28692024-12-18T20:02:33.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28702024-12-18T20:02:33.977ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 380.272442ms iteration = 29 status = null
28712024-12-18T20:02:33.979ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2e62f150-6310-4791-8147-c24b17af67ab", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
28722024-12-18T20:02:33.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28732024-12-18T20:02:33.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28742024-12-18T20:02:33.982ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28752024-12-18T20:02:33.982ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "deca0854-0a76-45df-8f2e-d975aedf2db9", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28762024-12-18T20:02:33.982ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28772024-12-18T20:02:33.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28782024-12-18T20:02:33.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28792024-12-18T20:02:33.983ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T19:48:29.764483Z, time_modified: 2024-12-18T19:48:29.764483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9066e168-08ec-47af-a018-fa1edb0a15cb, db_silo: Silo { identity: SiloIdentity { id: 9066e168-08ec-47af-a018-fa1edb0a15cb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T19:48:35.229287Z, time_modified: 2024-12-18T19:48:35.229287Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9066e168-08ec-47af-a018-fa1edb0a15cb, db_silo: Silo { identity: SiloIdentity { id: 9066e168-08ec-47af-a018-fa1edb0a15cb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T19:48:35.229287Z, time_modified: 2024-12-18T19:48:35.229287Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e" }] }) }
28802024-12-18T20:02:33.983ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 386.400307ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9066e168-08ec-47af-a018-fa1edb0a15cb","tls_certs":["828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e"]}},"default_endpoint":{"silo_id":"9066e168-08ec-47af-a018-fa1edb0a15cb","tls_certs":["828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28812024-12-18T20:02:33.984ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f126703f-7505-4e75-8ec3-7814c64ec820", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28822024-12-18T20:02:33.984ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28832024-12-18T20:02:33.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28842024-12-18T20:02:33.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28852024-12-18T20:02:33.986ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5590f819-967c-4599-868a-2e0c51a85be5", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28862024-12-18T20:02:33.986ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28872024-12-18T20:02:33.988ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
28882024-12-18T20:02:33.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 391.537483ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
28892024-12-18T20:02:33.989ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28902024-12-18T20:02:33.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28912024-12-18T20:02:33.993ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "15071528-e097-4231-81f2-3bce920c8523", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
28922024-12-18T20:02:33.994ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 397.178819ms iteration = 31 status = {}
28932024-12-18T20:02:34.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28942024-12-18T20:02:34.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28952024-12-18T20:02:34.057ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c592ee00-6719-4702-903e-a4aee00a8af1, rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(37c692d6-efbe-4d30-b3c8-683fe7cd5daa) } rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
28962024-12-18T20:02:34.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28972024-12-18T20:02:34.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28982024-12-18T20:02:34.068ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28992024-12-18T20:02:34.068ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e53bcf3e-cf16-4160-89e6-89e65b648902", "content-length": "134", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
29002024-12-18T20:02:34.068ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29012024-12-18T20:02:34.068ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 37c692d6-efbe-4d30-b3c8-683fe7cd5daa
29022024-12-18T20:02:34.068ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29032024-12-18T20:02:34.068ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29042024-12-18T20:02:34.068ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29052024-12-18T20:02:34.068ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29062024-12-18T20:02:34.068ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29072024-12-18T20:02:34.068ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29082024-12-18T20:02:34.069ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29092024-12-18T20:02:34.069ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29102024-12-18T20:02:34.069ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
29112024-12-18T20:02:34.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29122024-12-18T20:02:34.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29132024-12-18T20:02:34.072ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29142024-12-18T20:02:34.072ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "545e13ef-ca93-4a5d-864b-3d50373ea57e", "content-length": "2", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
29152024-12-18T20:02:34.072ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29162024-12-18T20:02:34.072ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "24a9b178-46ec-486a-9dce-ed6116a30dd2", "content-length": "52", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
29172024-12-18T20:02:34.072ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
29182024-12-18T20:02:34.072ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29192024-12-18T20:02:34.077ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
29202024-12-18T20:02:34.077ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 480.248977ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
29212024-12-18T20:02:34.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29222024-12-18T20:02:34.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29232024-12-18T20:02:34.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29242024-12-18T20:02:34.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29252024-12-18T20:02:34.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29262024-12-18T20:02:34.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29272024-12-18T20:02:34.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29282024-12-18T20:02:34.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29292024-12-18T20:02:34.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29302024-12-18T20:02:34.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29312024-12-18T20:02:34.129ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29322024-12-18T20:02:34.130ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8362b475-96d6-449b-8eee-1e97dddfab9f", "content-length": "691", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
29332024-12-18T20:02:34.130ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29342024-12-18T20:02:34.130ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29352024-12-18T20:02:34.130ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29362024-12-18T20:02:34.132ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 535.088816ms iteration = 30 status = {}
29372024-12-18T20:02:34.171ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "24026b53-757f-482e-baed-29793f27598c", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
29382024-12-18T20:02:34.172ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch = Switch0
29392024-12-18T20:02:34.172ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29402024-12-18T20:02:34.172ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f25c322f-a8df-4437-84c5-fde9510885df", "content-length": "682", "date": "Wed, 18 Dec 2024 20:02:33 GMT"} })
29412024-12-18T20:02:34.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29422024-12-18T20:02:34.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29432024-12-18T20:02:34.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29442024-12-18T20:02:34.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29452024-12-18T20:02:34.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29462024-12-18T20:02:34.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29472024-12-18T20:02:34.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29482024-12-18T20:02:34.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29492024-12-18T20:02:34.188ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 590.876183ms iteration = 29 status = {}
29502024-12-18T20:02:34.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1375 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 956abed7-fc3c-47de-ad44-eb7ef821d714 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
29512024-12-18T20:02:34.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f7c86a23-223e-4327-89dd-506faeb3a874 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29522024-12-18T20:02:34.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f7c86a23-223e-4327-89dd-506faeb3a874 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29532024-12-18T20:02:34.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f7c86a23-223e-4327-89dd-506faeb3a874 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29542024-12-18T20:02:35.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f9c01bac-1e20-484f-873a-53e954948083 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29552024-12-18T20:02:35.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f9c01bac-1e20-484f-873a-53e954948083 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29562024-12-18T20:02:35.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f9c01bac-1e20-484f-873a-53e954948083 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29572024-12-18T20:02:37.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8f066a57-cc48-4725-baf0-dd160c1efae8 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29582024-12-18T20:02:37.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8f066a57-cc48-4725-baf0-dd160c1efae8 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29592024-12-18T20:02:37.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8f066a57-cc48-4725-baf0-dd160c1efae8 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29602024-12-18T20:02:38.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 207aee3b-4fb3-409f-adb3-33604248ae2a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29612024-12-18T20:02:38.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 207aee3b-4fb3-409f-adb3-33604248ae2a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29622024-12-18T20:02:38.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 207aee3b-4fb3-409f-adb3-33604248ae2a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29632024-12-18T20:02:39.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c3939b8e-248a-4ceb-b15e-aa707ae6de30 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29642024-12-18T20:02:39.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c3939b8e-248a-4ceb-b15e-aa707ae6de30 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29652024-12-18T20:02:39.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c3939b8e-248a-4ceb-b15e-aa707ae6de30 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29662024-12-18T20:02:40.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a2adc362-01ef-4014-9d48-aa5cee0ea4b0 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29672024-12-18T20:02:40.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a2adc362-01ef-4014-9d48-aa5cee0ea4b0 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29682024-12-18T20:02:40.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a2adc362-01ef-4014-9d48-aa5cee0ea4b0 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29692024-12-18T20:02:41.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 40411e6a-431c-41b5-a642-75b0fa2f4924 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29702024-12-18T20:02:41.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 40411e6a-431c-41b5-a642-75b0fa2f4924 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29712024-12-18T20:02:41.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 40411e6a-431c-41b5-a642-75b0fa2f4924 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29722024-12-18T20:02:42.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7c1937f7-beb7-434f-ac00-515395d775e2 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29732024-12-18T20:02:42.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7c1937f7-beb7-434f-ac00-515395d775e2 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29742024-12-18T20:02:42.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7c1937f7-beb7-434f-ac00-515395d775e2 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29752024-12-18T20:02:43.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = faeb634c-d052-425e-8360-67f7e4240394 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29762024-12-18T20:02:43.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = faeb634c-d052-425e-8360-67f7e4240394 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29772024-12-18T20:02:43.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = faeb634c-d052-425e-8360-67f7e4240394 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
29782024-12-18T20:02:43.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
29792024-12-18T20:02:43.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29802024-12-18T20:02:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29812024-12-18T20:02:43.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
29822024-12-18T20:02:43.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29832024-12-18T20:02:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29842024-12-18T20:02:43.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29852024-12-18T20:02:43.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29862024-12-18T20:02:43.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29872024-12-18T20:02:43.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.297339ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29882024-12-18T20:02:43.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29892024-12-18T20:02:43.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29902024-12-18T20:02:43.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29912024-12-18T20:02:43.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29922024-12-18T20:02:43.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29932024-12-18T20:02:43.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29942024-12-18T20:02:43.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
29952024-12-18T20:02:43.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29962024-12-18T20:02:43.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29972024-12-18T20:02:43.617ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
29982024-12-18T20:02:43.617ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.203576ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
29992024-12-18T20:02:44.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b625db14-3007-4ca9-83dd-42a206a92e6d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30002024-12-18T20:02:44.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b625db14-3007-4ca9-83dd-42a206a92e6d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30012024-12-18T20:02:44.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b625db14-3007-4ca9-83dd-42a206a92e6d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30022024-12-18T20:02:44.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 5cee82a2-79b2-4770-a72b-9d3e44262a8e roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
30032024-12-18T20:02:44.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 5cee82a2-79b2-4770-a72b-9d3e44262a8e resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
30042024-12-18T20:02:44.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 5cee82a2-79b2-4770-a72b-9d3e44262a8e response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
30052024-12-18T20:02:44.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 0f3c2d91-a000-4aef-a952-cf97794ffc8d roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
30062024-12-18T20:02:44.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 0f3c2d91-a000-4aef-a952-cf97794ffc8d resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
30072024-12-18T20:02:44.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 0f3c2d91-a000-4aef-a952-cf97794ffc8d response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
30082024-12-18T20:02:44.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1289 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 6dcf0d40-fbb0-4681-b2fc-293e13826257 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
30092024-12-18T20:02:45.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 97f46f31-e881-4874-896e-c3f7e49593e4 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30102024-12-18T20:02:45.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 97f46f31-e881-4874-896e-c3f7e49593e4 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30112024-12-18T20:02:45.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 97f46f31-e881-4874-896e-c3f7e49593e4 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30122024-12-18T20:02:46.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 48d2eaee-9cb4-4078-81ea-707ee6bf13a6 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30132024-12-18T20:02:46.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 48d2eaee-9cb4-4078-81ea-707ee6bf13a6 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30142024-12-18T20:02:46.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 48d2eaee-9cb4-4078-81ea-707ee6bf13a6 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30152024-12-18T20:02:47.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7a8d6797-193a-4c25-9c44-06e8667af0e1 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30162024-12-18T20:02:47.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7a8d6797-193a-4c25-9c44-06e8667af0e1 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30172024-12-18T20:02:47.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7a8d6797-193a-4c25-9c44-06e8667af0e1 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30182024-12-18T20:02:48.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9aa24343-7a7b-4af3-af75-b1e119def7b7 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30192024-12-18T20:02:48.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9aa24343-7a7b-4af3-af75-b1e119def7b7 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30202024-12-18T20:02:48.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9aa24343-7a7b-4af3-af75-b1e119def7b7 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30212024-12-18T20:02:49.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8155454f-fa9e-4814-b75c-a65f6ae310db roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30222024-12-18T20:02:49.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8155454f-fa9e-4814-b75c-a65f6ae310db resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30232024-12-18T20:02:49.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8155454f-fa9e-4814-b75c-a65f6ae310db response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30242024-12-18T20:02:50.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 90e2e0a3-c9d7-413f-b179-dc7d5f621ed2 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30252024-12-18T20:02:50.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 90e2e0a3-c9d7-413f-b179-dc7d5f621ed2 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30262024-12-18T20:02:50.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 90e2e0a3-c9d7-413f-b179-dc7d5f621ed2 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30272024-12-18T20:02:51.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d5b0fbfe-eac1-4cd0-81f5-2b115d273e3a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30282024-12-18T20:02:51.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d5b0fbfe-eac1-4cd0-81f5-2b115d273e3a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30292024-12-18T20:02:51.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d5b0fbfe-eac1-4cd0-81f5-2b115d273e3a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30302024-12-18T20:02:52.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1ff4c16e-3181-447f-ab58-e73d8dd6b623 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30312024-12-18T20:02:52.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1ff4c16e-3181-447f-ab58-e73d8dd6b623 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30322024-12-18T20:02:52.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1ff4c16e-3181-447f-ab58-e73d8dd6b623 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30332024-12-18T20:02:53.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d583d20c-7069-48ea-8466-5ec15601d958 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30342024-12-18T20:02:53.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d583d20c-7069-48ea-8466-5ec15601d958 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30352024-12-18T20:02:53.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d583d20c-7069-48ea-8466-5ec15601d958 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30362024-12-18T20:02:53.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
30372024-12-18T20:02:53.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30382024-12-18T20:02:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30392024-12-18T20:02:53.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
30402024-12-18T20:02:53.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30412024-12-18T20:02:53.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30422024-12-18T20:02:53.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30432024-12-18T20:02:53.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30442024-12-18T20:02:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30452024-12-18T20:02:53.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30462024-12-18T20:02:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30472024-12-18T20:02:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30482024-12-18T20:02:53.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.646268ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30492024-12-18T20:02:53.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30502024-12-18T20:02:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30512024-12-18T20:02:53.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30522024-12-18T20:02:53.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
30532024-12-18T20:02:53.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30542024-12-18T20:02:53.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30552024-12-18T20:02:53.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
30562024-12-18T20:02:53.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.310684ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
30572024-12-18T20:02:54.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f0ad3d70-263e-409a-a0be-d31576f1db4e roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30582024-12-18T20:02:54.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f0ad3d70-263e-409a-a0be-d31576f1db4e resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30592024-12-18T20:02:54.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f0ad3d70-263e-409a-a0be-d31576f1db4e response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30602024-12-18T20:02:54.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1410 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = f98a0e37-5f48-446b-8f54-4fe3f6bba5ce response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
30612024-12-18T20:02:55.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3de1c762-fbaf-486a-be64-e4d4fa23bc30 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30622024-12-18T20:02:55.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3de1c762-fbaf-486a-be64-e4d4fa23bc30 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30632024-12-18T20:02:55.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3de1c762-fbaf-486a-be64-e4d4fa23bc30 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30642024-12-18T20:02:56.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bda22b4a-fefc-4358-a43f-803d0c314e9c roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30652024-12-18T20:02:56.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bda22b4a-fefc-4358-a43f-803d0c314e9c resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30662024-12-18T20:02:56.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bda22b4a-fefc-4358-a43f-803d0c314e9c response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30672024-12-18T20:02:57.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a739bfb3-e4f4-497f-9fb7-653be2854592 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30682024-12-18T20:02:57.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a739bfb3-e4f4-497f-9fb7-653be2854592 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30692024-12-18T20:02:57.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a739bfb3-e4f4-497f-9fb7-653be2854592 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30702024-12-18T20:02:58.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b47fd2a4-0364-44df-9a61-adeaf9a7be81 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30712024-12-18T20:02:58.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b47fd2a4-0364-44df-9a61-adeaf9a7be81 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30722024-12-18T20:02:58.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b47fd2a4-0364-44df-9a61-adeaf9a7be81 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30732024-12-18T20:02:59.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e969333e-0ce5-4162-88eb-ff69930de308 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30742024-12-18T20:02:59.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e969333e-0ce5-4162-88eb-ff69930de308 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30752024-12-18T20:02:59.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e969333e-0ce5-4162-88eb-ff69930de308 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30762024-12-18T20:02:59.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = d4707bfe-ec78-4985-9dc1-829d4213daff roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
30772024-12-18T20:02:59.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = d4707bfe-ec78-4985-9dc1-829d4213daff resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
30782024-12-18T20:02:59.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = d4707bfe-ec78-4985-9dc1-829d4213daff response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
30792024-12-18T20:02:59.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = b9824b86-2589-4e54-90c1-8e053c4efe1f roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
30802024-12-18T20:02:59.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = b9824b86-2589-4e54-90c1-8e053c4efe1f resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
30812024-12-18T20:02:59.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = b9824b86-2589-4e54-90c1-8e053c4efe1f response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
30822024-12-18T20:03:00.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a53ccd7f-715e-494f-a21d-4e95e9bef777 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30832024-12-18T20:03:00.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a53ccd7f-715e-494f-a21d-4e95e9bef777 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30842024-12-18T20:03:00.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a53ccd7f-715e-494f-a21d-4e95e9bef777 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30852024-12-18T20:03:01.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 299bfac8-f837-4bab-b3d1-5f6af25cca14 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30862024-12-18T20:03:01.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 299bfac8-f837-4bab-b3d1-5f6af25cca14 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30872024-12-18T20:03:01.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 299bfac8-f837-4bab-b3d1-5f6af25cca14 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30882024-12-18T20:03:02.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2110a507-940f-4f14-9f29-c79028f50218 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30892024-12-18T20:03:02.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2110a507-940f-4f14-9f29-c79028f50218 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30902024-12-18T20:03:02.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2110a507-940f-4f14-9f29-c79028f50218 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
30912024-12-18T20:03:03.596ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
30922024-12-18T20:03:03.597ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30932024-12-18T20:03:03.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
30942024-12-18T20:03:03.597ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
30952024-12-18T20:03:03.597ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30962024-12-18T20:03:03.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
30972024-12-18T20:03:03.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30982024-12-18T20:03:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30992024-12-18T20:03:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31002024-12-18T20:03:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31012024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
31022024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
31032024-12-18T20:03:03.598ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31042024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31052024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31062024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
31072024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31082024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
31092024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31102024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
31112024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31122024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
31132024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31142024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
31152024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
31162024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31172024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31182024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
31192024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31202024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
31212024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31222024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31232024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
31242024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
31252024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31262024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
31272024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31282024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31292024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31302024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31312024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31322024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31332024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31342024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31352024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31362024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31372024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31382024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31392024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31402024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31412024-12-18T20:03:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31422024-12-18T20:03:03.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c5071bff-aea1-4f4a-8dba-b4d5c024f43d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
31432024-12-18T20:03:03.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c5071bff-aea1-4f4a-8dba-b4d5c024f43d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
31442024-12-18T20:03:03.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1858, tv_nsec: 888574148 } })
31452024-12-18T20:03:03.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
31462024-12-18T20:03:03.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31472024-12-18T20:03:03.602ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1858, tv_nsec: 889670891 } })
31482024-12-18T20:03:03.602ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
31492024-12-18T20:03:03.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31502024-12-18T20:03:03.602ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.82363ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31512024-12-18T20:03:03.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31522024-12-18T20:03:03.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31532024-12-18T20:03:03.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31542024-12-18T20:03:03.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31552024-12-18T20:03:03.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31562024-12-18T20:03:03.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31572024-12-18T20:03:03.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582024-12-18T20:03:03.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.462785ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
31592024-12-18T20:03:03.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31602024-12-18T20:03:03.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31612024-12-18T20:03:03.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31622024-12-18T20:03:03.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31632024-12-18T20:03:03.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31642024-12-18T20:03:03.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31652024-12-18T20:03:03.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31662024-12-18T20:03:03.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31672024-12-18T20:03:03.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31682024-12-18T20:03:03.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31692024-12-18T20:03:03.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31702024-12-18T20:03:03.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31712024-12-18T20:03:03.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31722024-12-18T20:03:03.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31732024-12-18T20:03:03.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31742024-12-18T20:03:03.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31752024-12-18T20:03:03.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31762024-12-18T20:03:03.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c5071bff-aea1-4f4a-8dba-b4d5c024f43d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
31772024-12-18T20:03:03.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31782024-12-18T20:03:03.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31792024-12-18T20:03:03.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31802024-12-18T20:03:03.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31812024-12-18T20:03:03.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31822024-12-18T20:03:03.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31832024-12-18T20:03:03.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31842024-12-18T20:03:03.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31852024-12-18T20:03:03.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31862024-12-18T20:03:03.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31872024-12-18T20:03:03.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1858, tv_nsec: 905565638 } })
31882024-12-18T20:03:03.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
31892024-12-18T20:03:03.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31902024-12-18T20:03:03.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31912024-12-18T20:03:03.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31922024-12-18T20:03:03.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31932024-12-18T20:03:03.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31942024-12-18T20:03:03.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
31952024-12-18T20:03:03.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31962024-12-18T20:03:03.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31972024-12-18T20:03:03.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31982024-12-18T20:03:03.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31992024-12-18T20:03:03.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32002024-12-18T20:03:03.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
32012024-12-18T20:03:03.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.179857ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
32022024-12-18T20:03:03.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32032024-12-18T20:03:03.661ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32042024-12-18T20:03:03.661ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32052024-12-18T20:03:03.661ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4be244b1-e278-4476-90d9-d5add9779a68", "content-length": "26", "date": "Wed, 18 Dec 2024 20:03:03 GMT"} })
32062024-12-18T20:03:03.661ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32072024-12-18T20:03:03.662ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32082024-12-18T20:03:03.662ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32092024-12-18T20:03:03.663ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63628ae1-4aaa-4e0c-9a9c-e91d571a7368", "content-length": "26", "date": "Wed, 18 Dec 2024 20:03:03 GMT"} })
32102024-12-18T20:03:03.663ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32112024-12-18T20:03:03.663ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32122024-12-18T20:03:03.665ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32132024-12-18T20:03:03.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32142024-12-18T20:03:03.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32152024-12-18T20:03:03.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.840608ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
32162024-12-18T20:03:03.672ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32172024-12-18T20:03:03.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32182024-12-18T20:03:03.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.259348ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32192024-12-18T20:03:03.677ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32202024-12-18T20:03:03.677ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32212024-12-18T20:03:03.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32222024-12-18T20:03:03.677ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32232024-12-18T20:03:03.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32242024-12-18T20:03:03.678ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32252024-12-18T20:03:03.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32262024-12-18T20:03:03.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32272024-12-18T20:03:03.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.16279ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32282024-12-18T20:03:03.680ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32292024-12-18T20:03:03.680ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32302024-12-18T20:03:03.680ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32312024-12-18T20:03:03.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32322024-12-18T20:03:03.684ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 zone_address = fd00:1122:3344:101::2
32332024-12-18T20:03:03.684ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32342024-12-18T20:03:03.684ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "33b4b08b-8c53-4c46-ad87-96086293cb87", "content-length": "26", "date": "Wed, 18 Dec 2024 20:03:03 GMT"} })
32352024-12-18T20:03:03.684ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32362024-12-18T20:03:03.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
32372024-12-18T20:03:03.687ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32382024-12-18T20:03:03.687ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.0061ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32392024-12-18T20:03:03.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32402024-12-18T20:03:03.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
32412024-12-18T20:03:03.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32422024-12-18T20:03:03.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32432024-12-18T20:03:03.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 133.918225ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32442024-12-18T20:03:03.735ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 137.444837ms iteration = 30 status = 0
32452024-12-18T20:03:03.745ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32462024-12-18T20:03:03.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32472024-12-18T20:03:03.746ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32482024-12-18T20:03:03.746ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32492024-12-18T20:03:03.746ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.438953ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32502024-12-18T20:03:03.755ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32512024-12-18T20:03:03.756ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c093b97b-3568-4af6-96f3-e2f4aa06b471", "content-length": "2", "date": "Wed, 18 Dec 2024 20:03:02 GMT"} })
32522024-12-18T20:03:03.758ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 161.966731ms iteration = 30 status = {}
32532024-12-18T20:03:03.759ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32542024-12-18T20:03:03.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32552024-12-18T20:03:03.762ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 165.152467ms iteration = 30 status = null
32562024-12-18T20:03:03.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 196.42282ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
32572024-12-18T20:03:03.795ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32582024-12-18T20:03:03.795ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32592024-12-18T20:03:03.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32602024-12-18T20:03:03.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32612024-12-18T20:03:03.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32622024-12-18T20:03:03.817ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "32794250-83f1-4e9c-9953-4cdfd0ebce19", "content-length": "372", "date": "Wed, 18 Dec 2024 20:03:03 GMT"} })
32632024-12-18T20:03:03.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32642024-12-18T20:03:03.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32652024-12-18T20:03:03.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32662024-12-18T20:03:03.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32672024-12-18T20:03:03.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32682024-12-18T20:03:03.820ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 222.154859ms iteration = 34 status = {"physical_disks_added":0}
32692024-12-18T20:03:03.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32702024-12-18T20:03:03.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32712024-12-18T20:03:03.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32722024-12-18T20:03:03.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32732024-12-18T20:03:03.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32742024-12-18T20:03:03.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32752024-12-18T20:03:03.851ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c592ee00-6719-4702-903e-a4aee00a8af1, rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(37c692d6-efbe-4d30-b3c8-683fe7cd5daa) } rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
32762024-12-18T20:03:03.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32772024-12-18T20:03:03.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32782024-12-18T20:03:03.867ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32792024-12-18T20:03:03.868ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d0df8e2-442e-4361-9eb4-2360af1cb3cc", "content-length": "691", "date": "Wed, 18 Dec 2024 20:03:03 GMT"} })
32802024-12-18T20:03:03.868ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
32812024-12-18T20:03:03.868ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
32822024-12-18T20:03:03.868ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
32832024-12-18T20:03:03.869ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 271.835582ms iteration = 31 status = {}
32842024-12-18T20:03:03.874ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
32852024-12-18T20:03:03.874ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32862024-12-18T20:03:03.875ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "975453af-2922-4a25-8b5b-a05f6f48bd35", "date": "Wed, 18 Dec 2024 20:03:03 GMT"} })
32872024-12-18T20:03:03.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32882024-12-18T20:03:03.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32892024-12-18T20:03:03.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32902024-12-18T20:03:03.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32912024-12-18T20:03:03.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32922024-12-18T20:03:03.879ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "819485de-f3c9-4510-8ba8-cc2fd6dd84aa", "content-length": "134", "date": "Wed, 18 Dec 2024 20:03:02 GMT"} })
32932024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32942024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 37c692d6-efbe-4d30-b3c8-683fe7cd5daa
32952024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32962024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32972024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32982024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32992024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33002024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33012024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33022024-12-18T20:03:03.879ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33032024-12-18T20:03:03.880ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
33042024-12-18T20:03:03.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33052024-12-18T20:03:03.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33062024-12-18T20:03:03.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33072024-12-18T20:03:03.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33082024-12-18T20:03:03.881ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33092024-12-18T20:03:03.881ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f342a58-221c-488f-85f2-f01793a6e5d6", "content-length": "2", "date": "Wed, 18 Dec 2024 20:03:02 GMT"} })
33102024-12-18T20:03:03.881ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33112024-12-18T20:03:03.881ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cee95e44-758f-4e8e-bf0c-d4619cbbde75", "content-length": "52", "date": "Wed, 18 Dec 2024 20:03:02 GMT"} })
33122024-12-18T20:03:03.881ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
33132024-12-18T20:03:03.881ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33142024-12-18T20:03:03.883ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33152024-12-18T20:03:03.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33162024-12-18T20:03:03.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "108697ad-a44a-41f8-bcb5-1d2b1b69eae4", "date": "Wed, 18 Dec 2024 20:03:03 GMT"} })
33172024-12-18T20:03:03.889ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.339723ms iteration = 32 status = {}
33182024-12-18T20:03:04.013ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ec37df63-132e-41b6-8f22-8d7b6be8ae10", "date": "Wed, 18 Dec 2024 20:03:03 GMT"} })
33192024-12-18T20:03:04.013ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch = Switch0
33202024-12-18T20:03:04.013ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33212024-12-18T20:03:04.013ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4592e363-8b71-4232-8e2e-6af002f1a1fa", "content-length": "682", "date": "Wed, 18 Dec 2024 20:03:03 GMT"} })
33222024-12-18T20:03:04.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33232024-12-18T20:03:04.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33242024-12-18T20:03:04.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33252024-12-18T20:03:04.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33262024-12-18T20:03:04.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33272024-12-18T20:03:04.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33282024-12-18T20:03:04.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33292024-12-18T20:03:04.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33302024-12-18T20:03:04.031ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 433.825273ms iteration = 30 status = {}
33312024-12-18T20:03:04.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1264 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 428b9d6f-3c33-443f-b3be-3ff994f5e6a4 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
33322024-12-18T20:03:04.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0e51dfa8-5e9b-4d28-a923-1e8df75585b2 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33332024-12-18T20:03:04.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0e51dfa8-5e9b-4d28-a923-1e8df75585b2 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33342024-12-18T20:03:04.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0e51dfa8-5e9b-4d28-a923-1e8df75585b2 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33352024-12-18T20:03:05.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 61be1d2a-6b96-4334-8193-7d0544966d75 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33362024-12-18T20:03:05.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 61be1d2a-6b96-4334-8193-7d0544966d75 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33372024-12-18T20:03:05.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 61be1d2a-6b96-4334-8193-7d0544966d75 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33382024-12-18T20:03:06.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 4d9af9da-8845-4222-85d4-b6f21b5646b9 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33392024-12-18T20:03:06.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 4d9af9da-8845-4222-85d4-b6f21b5646b9 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33402024-12-18T20:03:06.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 4d9af9da-8845-4222-85d4-b6f21b5646b9 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33412024-12-18T20:03:07.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6f226a6f-229e-4ab3-b1ad-3ef619145f46 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33422024-12-18T20:03:07.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6f226a6f-229e-4ab3-b1ad-3ef619145f46 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33432024-12-18T20:03:07.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6f226a6f-229e-4ab3-b1ad-3ef619145f46 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33442024-12-18T20:03:08.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0a52f1e8-0cf6-43ff-a17a-9c5a6ca40095 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33452024-12-18T20:03:08.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0a52f1e8-0cf6-43ff-a17a-9c5a6ca40095 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33462024-12-18T20:03:08.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0a52f1e8-0cf6-43ff-a17a-9c5a6ca40095 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33472024-12-18T20:03:09.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 06eeb277-3553-4865-8d70-de3a1b7df564 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33482024-12-18T20:03:09.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 06eeb277-3553-4865-8d70-de3a1b7df564 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33492024-12-18T20:03:09.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 06eeb277-3553-4865-8d70-de3a1b7df564 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33502024-12-18T20:03:10.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7d6b7dd4-5ac6-4ba7-acf5-eb542d8eeb34 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33512024-12-18T20:03:10.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7d6b7dd4-5ac6-4ba7-acf5-eb542d8eeb34 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33522024-12-18T20:03:10.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7d6b7dd4-5ac6-4ba7-acf5-eb542d8eeb34 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33532024-12-18T20:03:11.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d3cc7bb3-c26b-4dd6-bc03-1e1208342710 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33542024-12-18T20:03:11.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d3cc7bb3-c26b-4dd6-bc03-1e1208342710 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33552024-12-18T20:03:11.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d3cc7bb3-c26b-4dd6-bc03-1e1208342710 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33562024-12-18T20:03:12.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5a4f6d22-3302-49eb-b7f8-afb98454691e roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33572024-12-18T20:03:12.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5a4f6d22-3302-49eb-b7f8-afb98454691e resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33582024-12-18T20:03:12.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5a4f6d22-3302-49eb-b7f8-afb98454691e response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33592024-12-18T20:03:13.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
33602024-12-18T20:03:13.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33612024-12-18T20:03:13.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33622024-12-18T20:03:13.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
33632024-12-18T20:03:13.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33642024-12-18T20:03:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33652024-12-18T20:03:13.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33662024-12-18T20:03:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33672024-12-18T20:03:13.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33682024-12-18T20:03:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33692024-12-18T20:03:13.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33702024-12-18T20:03:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33712024-12-18T20:03:13.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33722024-12-18T20:03:13.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33732024-12-18T20:03:13.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33742024-12-18T20:03:13.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
33752024-12-18T20:03:13.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33762024-12-18T20:03:13.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33772024-12-18T20:03:13.662ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
33782024-12-18T20:03:13.662ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.466266ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
33792024-12-18T20:03:13.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.003919ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33802024-12-18T20:03:13.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 79f14696-f863-4eb8-b8b1-0a082fd2ad30 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33812024-12-18T20:03:13.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 79f14696-f863-4eb8-b8b1-0a082fd2ad30 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33822024-12-18T20:03:13.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 79f14696-f863-4eb8-b8b1-0a082fd2ad30 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33832024-12-18T20:03:14.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1652 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = e3c620ed-5a94-4fae-97ab-ddc2ca7ace4f response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
33842024-12-18T20:03:14.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ef19fbad-96df-4c0e-8cd0-99af4285c8f3 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33852024-12-18T20:03:14.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ef19fbad-96df-4c0e-8cd0-99af4285c8f3 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33862024-12-18T20:03:14.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ef19fbad-96df-4c0e-8cd0-99af4285c8f3 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33872024-12-18T20:03:15.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 476cd55a-2a2b-4de5-912a-ce00152bc1c1 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33882024-12-18T20:03:15.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 476cd55a-2a2b-4de5-912a-ce00152bc1c1 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33892024-12-18T20:03:15.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 476cd55a-2a2b-4de5-912a-ce00152bc1c1 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33902024-12-18T20:03:16.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e2bd56ef-2ac6-463c-be1b-fa687c401d5c roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33912024-12-18T20:03:16.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e2bd56ef-2ac6-463c-be1b-fa687c401d5c resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33922024-12-18T20:03:16.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e2bd56ef-2ac6-463c-be1b-fa687c401d5c response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33932024-12-18T20:03:17.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6698b6fb-bae3-441b-9a3f-5536c2c8426b roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33942024-12-18T20:03:17.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6698b6fb-bae3-441b-9a3f-5536c2c8426b resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33952024-12-18T20:03:17.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 6698b6fb-bae3-441b-9a3f-5536c2c8426b response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33962024-12-18T20:03:18.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 86d0ca4d-9391-4d74-99c3-1bc3ff90b0c1 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33972024-12-18T20:03:18.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 86d0ca4d-9391-4d74-99c3-1bc3ff90b0c1 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33982024-12-18T20:03:18.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 86d0ca4d-9391-4d74-99c3-1bc3ff90b0c1 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
33992024-12-18T20:03:19.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 036d79c7-6cff-4132-970a-2d910f3d62cd roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34002024-12-18T20:03:19.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 036d79c7-6cff-4132-970a-2d910f3d62cd resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34012024-12-18T20:03:19.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 036d79c7-6cff-4132-970a-2d910f3d62cd response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34022024-12-18T20:03:21.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b0845904-a0e8-4358-a7f3-351e44b83fda roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34032024-12-18T20:03:21.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b0845904-a0e8-4358-a7f3-351e44b83fda resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34042024-12-18T20:03:21.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b0845904-a0e8-4358-a7f3-351e44b83fda response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34052024-12-18T20:03:22.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d60c56f2-f87f-447b-b12e-ab5d756c6b29 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34062024-12-18T20:03:22.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d60c56f2-f87f-447b-b12e-ab5d756c6b29 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34072024-12-18T20:03:22.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = d60c56f2-f87f-447b-b12e-ab5d756c6b29 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34082024-12-18T20:03:23.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2c1e5d4a-1d16-4335-9e0c-eebd6d1a5488 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34092024-12-18T20:03:23.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2c1e5d4a-1d16-4335-9e0c-eebd6d1a5488 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34102024-12-18T20:03:23.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2c1e5d4a-1d16-4335-9e0c-eebd6d1a5488 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34112024-12-18T20:03:23.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
34122024-12-18T20:03:23.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34132024-12-18T20:03:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34142024-12-18T20:03:23.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
34152024-12-18T20:03:23.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34162024-12-18T20:03:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34172024-12-18T20:03:23.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182024-12-18T20:03:23.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34192024-12-18T20:03:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34202024-12-18T20:03:23.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34212024-12-18T20:03:23.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34222024-12-18T20:03:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34232024-12-18T20:03:23.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34242024-12-18T20:03:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34252024-12-18T20:03:23.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34262024-12-18T20:03:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
34272024-12-18T20:03:23.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34282024-12-18T20:03:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34292024-12-18T20:03:23.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
34302024-12-18T20:03:23.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.071435ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
34312024-12-18T20:03:23.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.185909ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34322024-12-18T20:03:24.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ba4f98c0-999b-4fcc-8c41-7069dd8ff178 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34332024-12-18T20:03:24.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ba4f98c0-999b-4fcc-8c41-7069dd8ff178 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34342024-12-18T20:03:24.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ba4f98c0-999b-4fcc-8c41-7069dd8ff178 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34352024-12-18T20:03:24.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 2bfe8e58-57d3-4664-8c03-e355025ecab7 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
34362024-12-18T20:03:25.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 02e33850-3d62-4b1e-a286-b1b08dfcc8cf roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34372024-12-18T20:03:25.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 02e33850-3d62-4b1e-a286-b1b08dfcc8cf resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34382024-12-18T20:03:25.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 02e33850-3d62-4b1e-a286-b1b08dfcc8cf response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34392024-12-18T20:03:26.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 536e5b1b-9ab1-4451-b131-7d736e999a13 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34402024-12-18T20:03:26.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 536e5b1b-9ab1-4451-b131-7d736e999a13 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34412024-12-18T20:03:26.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 536e5b1b-9ab1-4451-b131-7d736e999a13 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34422024-12-18T20:03:27.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9bd50224-4327-4ff9-b843-222fb223b497 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34432024-12-18T20:03:27.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9bd50224-4327-4ff9-b843-222fb223b497 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34442024-12-18T20:03:27.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9bd50224-4327-4ff9-b843-222fb223b497 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34452024-12-18T20:03:28.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3364170e-2af8-46d1-9286-2a9552a27467 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34462024-12-18T20:03:28.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3364170e-2af8-46d1-9286-2a9552a27467 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34472024-12-18T20:03:28.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 3364170e-2af8-46d1-9286-2a9552a27467 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34482024-12-18T20:03:29.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 04dbce35-563d-47ea-8eff-8a19ee134347 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34492024-12-18T20:03:29.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 04dbce35-563d-47ea-8eff-8a19ee134347 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34502024-12-18T20:03:29.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 04dbce35-563d-47ea-8eff-8a19ee134347 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34512024-12-18T20:03:30.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8a451030-b3ec-435a-9515-51c877be563b roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34522024-12-18T20:03:30.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8a451030-b3ec-435a-9515-51c877be563b resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34532024-12-18T20:03:30.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8a451030-b3ec-435a-9515-51c877be563b response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34542024-12-18T20:03:31.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 72b52c83-c9c2-47e1-8993-c1ce4ce5b1a0 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34552024-12-18T20:03:31.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 72b52c83-c9c2-47e1-8993-c1ce4ce5b1a0 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34562024-12-18T20:03:31.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 72b52c83-c9c2-47e1-8993-c1ce4ce5b1a0 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34572024-12-18T20:03:32.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 90709d82-e422-423e-860b-7790e24e3150 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34582024-12-18T20:03:32.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 90709d82-e422-423e-860b-7790e24e3150 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34592024-12-18T20:03:32.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 90709d82-e422-423e-860b-7790e24e3150 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34602024-12-18T20:03:33.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 19add1b3-08ad-41c0-8fb6-901a6cee32ce roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34612024-12-18T20:03:33.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 19add1b3-08ad-41c0-8fb6-901a6cee32ce resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34622024-12-18T20:03:33.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 19add1b3-08ad-41c0-8fb6-901a6cee32ce response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
34632024-12-18T20:03:33.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
34642024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
34652024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34662024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
34672024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
34682024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
34692024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
34702024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34712024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
34722024-12-18T20:03:33.597ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-18 19:53:33.597065883 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
34732024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
34742024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
34752024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34762024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34772024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
34782024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
34792024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
34802024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
34812024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34822024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
34832024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
34842024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34852024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
34862024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
34872024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34882024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
34892024-12-18T20:03:33.597ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
34902024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
34912024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34922024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34932024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
34942024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
34952024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34962024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
34972024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
34982024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34992024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35002024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
35012024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35022024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
35032024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35042024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35052024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
35062024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35072024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
35082024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35092024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
35102024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35112024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
35122024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35132024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
35142024-12-18T20:03:33.597ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35152024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35162024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35172024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
35182024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
35192024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35202024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
35212024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35222024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35232024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
35242024-12-18T20:03:33.597ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
35252024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35262024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
35272024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35282024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
35292024-12-18T20:03:33.597ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66
35302024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.24\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66"}
35312024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35322024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35332024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
35342024-12-18T20:03:33.597ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4e3d8b46-b399-4d3c-bc66-63409f4abd06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9da4e3ea-a57c-4b2b-81c3-7f374155d667.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9da4e3ea-a57c-4b2b-81c3-7f374155d667.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1888, tv_nsec: 885187878 } })
35352024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35362024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35372024-12-18T20:03:33.597ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73c17a86-f1fb-4102-92b8-0059f9ce4d77.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89d5399b-5669-48fc-9549-d301f3010160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("967a5ab6-9437-47ac-b51c-7113605783e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("967a5ab6-9437-47ac-b51c-7113605783e5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1888, tv_nsec: 885232969 } })
35382024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35392024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35402024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
35412024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35422024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35432024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35442024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35452024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35462024-12-18T20:03:33.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35472024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
35482024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35492024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35502024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35512024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35522024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35532024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35542024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35552024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35562024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35572024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35582024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35592024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35602024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
35612024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35622024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.096462ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
35632024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
35642024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.335367ms iteration = 17 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
35652024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35662024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35672024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35682024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35692024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35702024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35712024-12-18T20:03:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35722024-12-18T20:03:33.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35732024-12-18T20:03:33.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35742024-12-18T20:03:33.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35752024-12-18T20:03:33.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1888, tv_nsec: 888637849 } })
35762024-12-18T20:03:33.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
35772024-12-18T20:03:33.601ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.482772ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35782024-12-18T20:03:33.601ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-18 19:53:33.597065883 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
35792024-12-18T20:03:33.601ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.623945ms iteration = 16 status = {"expiration":"2024-12-18T19:53:33.597065883Z","pruned":[]}
35802024-12-18T20:03:33.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35812024-12-18T20:03:33.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35822024-12-18T20:03:33.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35832024-12-18T20:03:33.603ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1888, tv_nsec: 890680641 } })
35842024-12-18T20:03:33.603ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
35852024-12-18T20:03:33.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35862024-12-18T20:03:33.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35872024-12-18T20:03:33.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35882024-12-18T20:03:33.605ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.158618ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
35892024-12-18T20:03:33.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35902024-12-18T20:03:33.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35912024-12-18T20:03:33.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35922024-12-18T20:03:33.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35932024-12-18T20:03:33.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35942024-12-18T20:03:33.607ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35952024-12-18T20:03:33.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35962024-12-18T20:03:33.609ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35972024-12-18T20:03:33.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35982024-12-18T20:03:33.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35992024-12-18T20:03:33.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36002024-12-18T20:03:33.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36012024-12-18T20:03:33.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36022024-12-18T20:03:33.612ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36032024-12-18T20:03:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36042024-12-18T20:03:33.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36052024-12-18T20:03:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36062024-12-18T20:03:33.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36072024-12-18T20:03:33.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36082024-12-18T20:03:33.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36092024-12-18T20:03:33.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36102024-12-18T20:03:33.616ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36112024-12-18T20:03:33.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36122024-12-18T20:03:33.618ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36132024-12-18T20:03:33.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36142024-12-18T20:03:33.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36152024-12-18T20:03:33.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36162024-12-18T20:03:33.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
36172024-12-18T20:03:33.620ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36182024-12-18T20:03:33.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36192024-12-18T20:03:33.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36202024-12-18T20:03:33.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36212024-12-18T20:03:33.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36222024-12-18T20:03:33.622ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36232024-12-18T20:03:33.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36242024-12-18T20:03:33.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36252024-12-18T20:03:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36262024-12-18T20:03:33.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36272024-12-18T20:03:33.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36282024-12-18T20:03:33.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36292024-12-18T20:03:33.625ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36302024-12-18T20:03:33.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36312024-12-18T20:03:33.627ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36322024-12-18T20:03:33.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36332024-12-18T20:03:33.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36342024-12-18T20:03:33.630ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
36352024-12-18T20:03:33.630ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
36362024-12-18T20:03:33.630ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
36372024-12-18T20:03:33.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36382024-12-18T20:03:33.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36392024-12-18T20:03:33.637ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1888, tv_nsec: 924546748 } })
36402024-12-18T20:03:33.637ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
36412024-12-18T20:03:33.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36422024-12-18T20:03:33.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36432024-12-18T20:03:33.654ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36442024-12-18T20:03:33.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.690806ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36452024-12-18T20:03:33.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36462024-12-18T20:03:33.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
36472024-12-18T20:03:33.671ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36482024-12-18T20:03:33.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36492024-12-18T20:03:33.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36502024-12-18T20:03:33.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36512024-12-18T20:03:33.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36522024-12-18T20:03:33.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36532024-12-18T20:03:33.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36542024-12-18T20:03:33.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36552024-12-18T20:03:33.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36562024-12-18T20:03:33.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36572024-12-18T20:03:33.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36582024-12-18T20:03:33.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36592024-12-18T20:03:33.688ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36602024-12-18T20:03:33.688ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36612024-12-18T20:03:33.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36622024-12-18T20:03:33.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36632024-12-18T20:03:33.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36642024-12-18T20:03:33.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36652024-12-18T20:03:33.690ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36662024-12-18T20:03:33.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36672024-12-18T20:03:33.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.574965ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
36682024-12-18T20:03:33.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36692024-12-18T20:03:33.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36702024-12-18T20:03:33.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36712024-12-18T20:03:33.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36722024-12-18T20:03:33.695ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36732024-12-18T20:03:33.695ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36742024-12-18T20:03:33.695ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36752024-12-18T20:03:33.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36762024-12-18T20:03:33.696ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
36772024-12-18T20:03:33.696ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
36782024-12-18T20:03:33.696ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 99.120799ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
36792024-12-18T20:03:33.697ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36802024-12-18T20:03:33.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36812024-12-18T20:03:33.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 101.711612ms iteration = 31 status = {"errors":[],"records_set_to_done":[]}
36822024-12-18T20:03:33.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36832024-12-18T20:03:33.700ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36842024-12-18T20:03:33.700ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36852024-12-18T20:03:33.700ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36862024-12-18T20:03:33.700ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36872024-12-18T20:03:33.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36882024-12-18T20:03:33.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36892024-12-18T20:03:33.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.217524ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36902024-12-18T20:03:33.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36912024-12-18T20:03:33.703ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36922024-12-18T20:03:33.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36932024-12-18T20:03:33.703ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942024-12-18T20:03:33.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36952024-12-18T20:03:33.706ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36962024-12-18T20:03:33.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36972024-12-18T20:03:33.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36982024-12-18T20:03:33.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36992024-12-18T20:03:33.710ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 113.563845ms iteration = 7 status = {"nsuccess":5}
37002024-12-18T20:03:33.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37012024-12-18T20:03:33.714ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37022024-12-18T20:03:33.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37032024-12-18T20:03:33.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37042024-12-18T20:03:33.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.712091ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37052024-12-18T20:03:33.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37062024-12-18T20:03:33.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37072024-12-18T20:03:33.727ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
37082024-12-18T20:03:33.727ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
37092024-12-18T20:03:33.727ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 130.040205ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
37102024-12-18T20:03:33.730ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
37112024-12-18T20:03:33.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.866844ms iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
37122024-12-18T20:03:33.731ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
37132024-12-18T20:03:33.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37142024-12-18T20:03:33.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
37152024-12-18T20:03:33.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37162024-12-18T20:03:33.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37172024-12-18T20:03:33.763ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37182024-12-18T20:03:33.763ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37192024-12-18T20:03:33.763ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dcda03d-9a91-4c4b-8a84-53c8adb774f8", "content-length": "26", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} })
37202024-12-18T20:03:33.763ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37212024-12-18T20:03:33.766ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37222024-12-18T20:03:33.767ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37232024-12-18T20:03:33.767ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37242024-12-18T20:03:33.767ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cc74d3c-f572-41f5-95ed-159bb059f94e", "content-length": "26", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} })
37252024-12-18T20:03:33.767ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37262024-12-18T20:03:33.769ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37272024-12-18T20:03:33.771ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
37282024-12-18T20:03:33.771ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c5344268-eb33-4765-9d91-b9438861661e dns_zone_name = oxide.test found_so_far = 0 version = 2
37292024-12-18T20:03:33.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37302024-12-18T20:03:33.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37312024-12-18T20:03:33.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37322024-12-18T20:03:33.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
37332024-12-18T20:03:33.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37342024-12-18T20:03:33.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37352024-12-18T20:03:33.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37362024-12-18T20:03:33.777ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
37372024-12-18T20:03:33.778ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 180.954071ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
37382024-12-18T20:03:33.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37392024-12-18T20:03:33.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37402024-12-18T20:03:33.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37412024-12-18T20:03:33.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37422024-12-18T20:03:33.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37432024-12-18T20:03:33.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37442024-12-18T20:03:33.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37452024-12-18T20:03:33.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37462024-12-18T20:03:33.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37472024-12-18T20:03:33.796ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37482024-12-18T20:03:33.798ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c5344268-eb33-4765-9d91-b9438861661e dns_zone_name = oxide.test found_so_far = 1 version = 2
37492024-12-18T20:03:33.798ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
37502024-12-18T20:03:33.798ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-18 19:48:35.279811 UTC dns_group = external generation = 2
37512024-12-18T20:03:33.798ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 201.156417ms iteration = 17 status = {"generation":2}
37522024-12-18T20:03:33.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37532024-12-18T20:03:33.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
37542024-12-18T20:03:33.801ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37552024-12-18T20:03:33.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37562024-12-18T20:03:33.803ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37572024-12-18T20:03:33.803ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37582024-12-18T20:03:33.803ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 206.1765ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37592024-12-18T20:03:33.803ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37602024-12-18T20:03:33.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37612024-12-18T20:03:33.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
37622024-12-18T20:03:33.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37632024-12-18T20:03:33.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37642024-12-18T20:03:33.806ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37652024-12-18T20:03:33.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37662024-12-18T20:03:33.810ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
37672024-12-18T20:03:33.810ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
37682024-12-18T20:03:33.810ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
37692024-12-18T20:03:33.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37702024-12-18T20:03:33.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37712024-12-18T20:03:33.812ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 zone_address = fd00:1122:3344:101::2
37722024-12-18T20:03:33.812ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37732024-12-18T20:03:33.812ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37742024-12-18T20:03:33.813ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a3fcee1-f4fd-4bf7-9663-86f04033f0d5", "content-length": "26", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} })
37752024-12-18T20:03:33.813ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37762024-12-18T20:03:33.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37772024-12-18T20:03:33.814ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-18T19:48:29.764483Z, time_modified: 2024-12-18T19:48:29.764483Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9066e168-08ec-47af-a018-fa1edb0a15cb, db_silo: Silo { identity: SiloIdentity { id: 9066e168-08ec-47af-a018-fa1edb0a15cb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T19:48:35.229287Z, time_modified: 2024-12-18T19:48:35.229287Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9066e168-08ec-47af-a018-fa1edb0a15cb, db_silo: Silo { identity: SiloIdentity { id: 9066e168-08ec-47af-a018-fa1edb0a15cb, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-18T19:48:35.229287Z, time_modified: 2024-12-18T19:48:35.229287Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e" }] }) }
37782024-12-18T20:03:33.814ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 217.860971ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9066e168-08ec-47af-a018-fa1edb0a15cb","tls_certs":["828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e"]}},"default_endpoint":{"silo_id":"9066e168-08ec-47af-a018-fa1edb0a15cb","tls_certs":["828522516b4618d31efccf12f24c2f85df627c6a8e932a7a26a09fc42ddf372e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
37792024-12-18T20:03:33.815ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
37802024-12-18T20:03:33.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37812024-12-18T20:03:33.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37822024-12-18T20:03:33.907ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
37832024-12-18T20:03:33.907ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 309.783591ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
37842024-12-18T20:03:33.909ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 312.348485ms iteration = 35 status = {"physical_disks_added":0}
37852024-12-18T20:03:34.035ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37862024-12-18T20:03:34.074ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
37872024-12-18T20:03:34.075ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f2558ee8-dc72-4cb6-b672-c27a5bfa123f", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37882024-12-18T20:03:34.075ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37892024-12-18T20:03:34.077ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2ad2899f-aa43-47b3-bf42-21c5f9aef2a7", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37902024-12-18T20:03:34.077ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37912024-12-18T20:03:34.079ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37922024-12-18T20:03:34.079ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 482.020074ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
37932024-12-18T20:03:34.095ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37942024-12-18T20:03:34.095ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "408be804-b688-4052-89a1-f90c1529c714", "content-length": "2", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} })
37952024-12-18T20:03:34.097ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37962024-12-18T20:03:34.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37972024-12-18T20:03:34.129ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 532.253498ms iteration = 31 status = {}
37982024-12-18T20:03:34.142ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37992024-12-18T20:03:34.142ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38002024-12-18T20:03:34.142ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3360a68b-9ecb-426a-ad7a-f6d6e4b7a06d", "content-length": "372", "date": "Wed, 18 Dec 2024 20:03:34 GMT"} })
38012024-12-18T20:03:34.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38022024-12-18T20:03:34.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38032024-12-18T20:03:34.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38042024-12-18T20:03:34.144ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 547.210665ms iteration = 31 status = 0
38052024-12-18T20:03:34.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38062024-12-18T20:03:34.146ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 548.554763ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38072024-12-18T20:03:34.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38082024-12-18T20:03:34.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38092024-12-18T20:03:34.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38102024-12-18T20:03:34.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
38112024-12-18T20:03:34.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38122024-12-18T20:03:34.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38132024-12-18T20:03:34.150ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 553.30881ms iteration = 31 status = null
38142024-12-18T20:03:34.151ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
38152024-12-18T20:03:34.151ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8fc962cf-e51f-448b-b0b6-3c8cab569201 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
38162024-12-18T20:03:34.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38172024-12-18T20:03:34.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38182024-12-18T20:03:34.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38192024-12-18T20:03:34.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38202024-12-18T20:03:34.152ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38212024-12-18T20:03:34.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38222024-12-18T20:03:34.153ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
38232024-12-18T20:03:34.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38242024-12-18T20:03:34.153ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "573cc812-e6fd-4601-8ace-11b152da93bc", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
38252024-12-18T20:03:34.153ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
38262024-12-18T20:03:34.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38272024-12-18T20:03:34.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38282024-12-18T20:03:34.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38292024-12-18T20:03:34.156ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ba252204-2626-45aa-8e97-4da1e5a7daa2", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
38302024-12-18T20:03:34.156ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
38312024-12-18T20:03:34.156ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38322024-12-18T20:03:34.156ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38332024-12-18T20:03:34.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38342024-12-18T20:03:34.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38352024-12-18T20:03:34.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38362024-12-18T20:03:34.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38372024-12-18T20:03:34.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38382024-12-18T20:03:34.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38392024-12-18T20:03:34.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38402024-12-18T20:03:34.158ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2d496548-356a-4792-943d-d72e7067e303", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
38412024-12-18T20:03:34.158ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
38422024-12-18T20:03:34.159ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8fc962cf-e51f-448b-b0b6-3c8cab569201 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
38432024-12-18T20:03:34.159ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
38442024-12-18T20:03:34.159ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-18 19:48:33.465914 UTC dns_group = internal generation = 1
38452024-12-18T20:03:34.159ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 561.959908ms iteration = 17 status = {"generation":1}
38462024-12-18T20:03:34.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38472024-12-18T20:03:34.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38482024-12-18T20:03:34.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38492024-12-18T20:03:34.160ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38502024-12-18T20:03:34.160ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
38512024-12-18T20:03:34.160ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 563.698935ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
38522024-12-18T20:03:34.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38532024-12-18T20:03:34.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38542024-12-18T20:03:34.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38552024-12-18T20:03:34.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38562024-12-18T20:03:34.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38572024-12-18T20:03:34.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38582024-12-18T20:03:34.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
38592024-12-18T20:03:34.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38602024-12-18T20:03:34.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38612024-12-18T20:03:34.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38622024-12-18T20:03:34.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38632024-12-18T20:03:34.170ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38642024-12-18T20:03:34.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38652024-12-18T20:03:34.202ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
38662024-12-18T20:03:34.202ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38672024-12-18T20:03:34.202ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "443266e3-7915-4ec6-ac5b-3837fb5451ee", "date": "Wed, 18 Dec 2024 20:03:34 GMT"} })
38682024-12-18T20:03:34.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38692024-12-18T20:03:34.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38702024-12-18T20:03:34.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38712024-12-18T20:03:34.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38722024-12-18T20:03:34.241ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38732024-12-18T20:03:34.242ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "57ea12cf-aafc-47b3-8036-417c8bb9ee60", "content-length": "691", "date": "Wed, 18 Dec 2024 20:03:34 GMT"} })
38742024-12-18T20:03:34.242ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
38752024-12-18T20:03:34.242ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
38762024-12-18T20:03:34.242ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
38772024-12-18T20:03:34.243ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 645.954276ms iteration = 32 status = {}
38782024-12-18T20:03:34.244ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c592ee00-6719-4702-903e-a4aee00a8af1, rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(37c692d6-efbe-4d30-b3c8-683fe7cd5daa) } rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
38792024-12-18T20:03:34.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38802024-12-18T20:03:34.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38812024-12-18T20:03:34.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38822024-12-18T20:03:34.245ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38832024-12-18T20:03:34.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38842024-12-18T20:03:34.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38852024-12-18T20:03:34.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38862024-12-18T20:03:34.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38872024-12-18T20:03:34.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38882024-12-18T20:03:34.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38892024-12-18T20:03:34.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38902024-12-18T20:03:34.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38912024-12-18T20:03:34.250ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38922024-12-18T20:03:34.250ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38932024-12-18T20:03:34.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38942024-12-18T20:03:34.251ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9a2120a2-29a1-4bf2-a099-cda27d2d423b", "date": "Wed, 18 Dec 2024 20:03:34 GMT"} })
38952024-12-18T20:03:34.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38962024-12-18T20:03:34.252ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38972024-12-18T20:03:34.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38982024-12-18T20:03:34.253ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b74b868-7f0c-4df1-a736-2fcf12d76a7b", "content-length": "134", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} })
38992024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39002024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 37c692d6-efbe-4d30-b3c8-683fe7cd5daa
39012024-12-18T20:03:34.253ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 655.828869ms iteration = 33 status = {}
39022024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39032024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39042024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39052024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39062024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39072024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39082024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39092024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39102024-12-18T20:03:34.253ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
39112024-12-18T20:03:34.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39122024-12-18T20:03:34.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39132024-12-18T20:03:34.255ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39142024-12-18T20:03:34.255ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "97d18bb7-71f0-4184-b6c0-227bf369b1ff", "content-length": "2", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} })
39152024-12-18T20:03:34.255ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39162024-12-18T20:03:34.255ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b163fa0-17bb-4603-9355-315dbbd0e44b", "content-length": "52", "date": "Wed, 18 Dec 2024 20:03:33 GMT"} })
39172024-12-18T20:03:34.255ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
39182024-12-18T20:03:34.255ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39192024-12-18T20:03:34.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
39202024-12-18T20:03:34.255ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39212024-12-18T20:03:34.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39222024-12-18T20:03:34.257ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39232024-12-18T20:03:34.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39242024-12-18T20:03:34.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39252024-12-18T20:03:34.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39262024-12-18T20:03:34.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39272024-12-18T20:03:34.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
39282024-12-18T20:03:34.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39292024-12-18T20:03:34.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39302024-12-18T20:03:34.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39312024-12-18T20:03:34.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39322024-12-18T20:03:34.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39332024-12-18T20:03:34.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39342024-12-18T20:03:34.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39352024-12-18T20:03:34.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39362024-12-18T20:03:34.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39372024-12-18T20:03:34.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39382024-12-18T20:03:34.273ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39392024-12-18T20:03:34.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39402024-12-18T20:03:34.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39412024-12-18T20:03:34.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39422024-12-18T20:03:34.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39432024-12-18T20:03:34.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39442024-12-18T20:03:34.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39452024-12-18T20:03:34.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
39462024-12-18T20:03:34.280ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39472024-12-18T20:03:34.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39482024-12-18T20:03:34.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39492024-12-18T20:03:34.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39502024-12-18T20:03:34.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39512024-12-18T20:03:34.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39522024-12-18T20:03:34.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39532024-12-18T20:03:34.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
39542024-12-18T20:03:34.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39552024-12-18T20:03:34.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39562024-12-18T20:03:34.298ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
39572024-12-18T20:03:34.299ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39582024-12-18T20:03:34.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39592024-12-18T20:03:34.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39602024-12-18T20:03:34.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
39612024-12-18T20:03:34.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39622024-12-18T20:03:34.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39632024-12-18T20:03:34.304ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
39642024-12-18T20:03:34.304ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
39652024-12-18T20:03:34.304ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
39662024-12-18T20:03:34.361ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d679a09a-6b3d-4fed-b389-6e28f2b3f1c3", "date": "Wed, 18 Dec 2024 20:03:34 GMT"} })
39672024-12-18T20:03:34.361ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch = Switch0
39682024-12-18T20:03:34.361ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39692024-12-18T20:03:34.361ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d92401b3-c423-4f59-b4d8-9a3ddad71ea6", "content-length": "682", "date": "Wed, 18 Dec 2024 20:03:34 GMT"} })
39702024-12-18T20:03:34.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39712024-12-18T20:03:34.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39722024-12-18T20:03:34.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 337e8755-ab8f-48df-814b-e57a2f346468 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
39732024-12-18T20:03:34.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 337e8755-ab8f-48df-814b-e57a2f346468 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
39742024-12-18T20:03:34.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 337e8755-ab8f-48df-814b-e57a2f346468 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
39752024-12-18T20:03:34.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39762024-12-18T20:03:34.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39772024-12-18T20:03:34.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39782024-12-18T20:03:34.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39792024-12-18T20:03:34.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39802024-12-18T20:03:34.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39812024-12-18T20:03:34.379ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 781.8285ms iteration = 31 status = {}
39822024-12-18T20:03:34.461ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 58ee29db-9185-4216-97e8-559d204ec1d2, time_created: 2024-12-18T19:48:32.534550Z, time_modified: 2024-12-18T19:48:32.534550Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
39832024-12-18T20:03:34.461ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
39842024-12-18T20:03:34.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39852024-12-18T20:03:34.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39862024-12-18T20:03:34.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39872024-12-18T20:03:34.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39882024-12-18T20:03:34.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39892024-12-18T20:03:34.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
39902024-12-18T20:03:34.498ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
39912024-12-18T20:03:34.499ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "2fe4fc9e-29ba-463c-96a7-7cf6656f14fb", "date": "Wed, 18 Dec 2024 20:03:34 GMT"} })
39922024-12-18T20:03:34.501ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
39932024-12-18T20:03:34.501ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 904.055854ms
39942024-12-18T20:03:34.501ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 904.066164ms iteration = 4 status = {}
39952024-12-18T20:03:34.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1350 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 747f9e74-dda4-450a-bc28-57b477b620c5 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
39962024-12-18T20:03:35.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f1f4ae1c-5a81-4d70-9355-d68ade88588d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
39972024-12-18T20:03:35.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f1f4ae1c-5a81-4d70-9355-d68ade88588d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
39982024-12-18T20:03:35.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f1f4ae1c-5a81-4d70-9355-d68ade88588d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
39992024-12-18T20:03:36.402ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
40002024-12-18T20:03:36.402ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
40012024-12-18T20:03:36.432ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
40022024-12-18T20:03:36.432ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50697
40032024-12-18T20:03:36.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a9bff0f4-8f01-454f-8565-cbe1aa7e3e6a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40042024-12-18T20:03:36.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50697 req_id = 034fa85f-d130-4089-b9d0-a0b6ca5fc8ae roles = RoleSet { roles: {} } uri = /metrics/producers
40052024-12-18T20:03:36.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a9bff0f4-8f01-454f-8565-cbe1aa7e3e6a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40062024-12-18T20:03:36.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50697 req_id = 034fa85f-d130-4089-b9d0-a0b6ca5fc8ae resource = Database result = Ok(()) uri = /metrics/producers
40072024-12-18T20:03:36.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a9bff0f4-8f01-454f-8565-cbe1aa7e3e6a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40082024-12-18T20:03:36.486ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = 1139ebda-6055-49a8-8243-f0019044de70
40092024-12-18T20:03:36.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53393 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50697 req_id = 034fa85f-d130-4089-b9d0-a0b6ca5fc8ae response_code = 201 uri = /metrics/producers
40102024-12-18T20:03:36.486ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "034fa85f-d130-4089-b9d0-a0b6ca5fc8ae", "content-length": "41", "date": "Wed, 18 Dec 2024 20:03:36 GMT"} })
40112024-12-18T20:03:36.488ZDEBGnexus (producer-registration-task): registered with nexus successfully
40122024-12-18T20:03:36.488ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
40132024-12-18T20:03:37.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 71dac496-00db-4bbd-bf89-050abe026e6d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40142024-12-18T20:03:37.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 71dac496-00db-4bbd-bf89-050abe026e6d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40152024-12-18T20:03:37.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 71dac496-00db-4bbd-bf89-050abe026e6d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40162024-12-18T20:03:38.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ed94728a-2865-4e4b-b881-0b5cf5bd4614 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40172024-12-18T20:03:38.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ed94728a-2865-4e4b-b881-0b5cf5bd4614 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40182024-12-18T20:03:38.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ed94728a-2865-4e4b-b881-0b5cf5bd4614 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40192024-12-18T20:03:39.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 51c0555d-43a4-42f7-9f6d-1f66db3e7d6d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40202024-12-18T20:03:39.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 51c0555d-43a4-42f7-9f6d-1f66db3e7d6d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40212024-12-18T20:03:39.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 51c0555d-43a4-42f7-9f6d-1f66db3e7d6d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40222024-12-18T20:03:40.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 59668efa-fdd4-4311-8da9-589bcfe5cabb roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40232024-12-18T20:03:40.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 59668efa-fdd4-4311-8da9-589bcfe5cabb resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40242024-12-18T20:03:40.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 59668efa-fdd4-4311-8da9-589bcfe5cabb response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40252024-12-18T20:03:41.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = cb4bf768-16dd-403a-a166-aefef6f6f680 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40262024-12-18T20:03:41.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = cb4bf768-16dd-403a-a166-aefef6f6f680 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40272024-12-18T20:03:41.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = cb4bf768-16dd-403a-a166-aefef6f6f680 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40282024-12-18T20:03:42.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c661843e-fd64-4426-8524-85bb80c99827 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40292024-12-18T20:03:42.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c661843e-fd64-4426-8524-85bb80c99827 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40302024-12-18T20:03:42.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c661843e-fd64-4426-8524-85bb80c99827 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40312024-12-18T20:03:43.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2f7063af-4827-4483-96ce-ce514f058787 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40322024-12-18T20:03:43.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2f7063af-4827-4483-96ce-ce514f058787 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40332024-12-18T20:03:43.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2f7063af-4827-4483-96ce-ce514f058787 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40342024-12-18T20:03:43.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
40352024-12-18T20:03:43.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40362024-12-18T20:03:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40372024-12-18T20:03:43.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
40382024-12-18T20:03:43.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40392024-12-18T20:03:43.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40402024-12-18T20:03:43.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40412024-12-18T20:03:43.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40422024-12-18T20:03:43.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40432024-12-18T20:03:43.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.916791ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40442024-12-18T20:03:43.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40452024-12-18T20:03:43.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40462024-12-18T20:03:43.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40472024-12-18T20:03:43.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40482024-12-18T20:03:43.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40492024-12-18T20:03:43.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40502024-12-18T20:03:43.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
40512024-12-18T20:03:43.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40522024-12-18T20:03:43.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40532024-12-18T20:03:43.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
40542024-12-18T20:03:43.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.250598ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
40552024-12-18T20:03:44.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1710 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 4facbaad-939a-4769-b36f-a2712afc2560 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
40562024-12-18T20:03:44.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 47209363-8ab9-4ecc-9e38-950f38974a5d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40572024-12-18T20:03:44.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 47209363-8ab9-4ecc-9e38-950f38974a5d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40582024-12-18T20:03:44.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 47209363-8ab9-4ecc-9e38-950f38974a5d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40592024-12-18T20:03:45.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 874a1e88-8389-4f5c-98a9-d527b230e356 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40602024-12-18T20:03:45.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 874a1e88-8389-4f5c-98a9-d527b230e356 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40612024-12-18T20:03:45.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 874a1e88-8389-4f5c-98a9-d527b230e356 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40622024-12-18T20:03:46.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2407b7be-d4d9-4e3b-949e-6a962170d74b roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40632024-12-18T20:03:46.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2407b7be-d4d9-4e3b-949e-6a962170d74b resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40642024-12-18T20:03:46.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 2407b7be-d4d9-4e3b-949e-6a962170d74b response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40652024-12-18T20:03:47.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 09ef39a4-0836-425c-9f79-5929d8037b72 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40662024-12-18T20:03:47.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 09ef39a4-0836-425c-9f79-5929d8037b72 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40672024-12-18T20:03:47.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 09ef39a4-0836-425c-9f79-5929d8037b72 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40682024-12-18T20:03:48.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1aead994-5711-4a9f-acfc-b5b1f8f25006 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40692024-12-18T20:03:48.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1aead994-5711-4a9f-acfc-b5b1f8f25006 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40702024-12-18T20:03:48.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1aead994-5711-4a9f-acfc-b5b1f8f25006 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40712024-12-18T20:03:49.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 55af3899-2cb0-47ff-b3d2-bdfa9c95adfe roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40722024-12-18T20:03:49.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 55af3899-2cb0-47ff-b3d2-bdfa9c95adfe resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40732024-12-18T20:03:49.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 55af3899-2cb0-47ff-b3d2-bdfa9c95adfe response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40742024-12-18T20:03:50.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9db11dc0-6cda-4a1e-8d8b-7625089fa41b roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40752024-12-18T20:03:50.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9db11dc0-6cda-4a1e-8d8b-7625089fa41b resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40762024-12-18T20:03:50.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9db11dc0-6cda-4a1e-8d8b-7625089fa41b response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40772024-12-18T20:03:51.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b88ea29c-621b-491b-a4fe-7b5bd3f745cd roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40782024-12-18T20:03:51.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b88ea29c-621b-491b-a4fe-7b5bd3f745cd resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40792024-12-18T20:03:51.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b88ea29c-621b-491b-a4fe-7b5bd3f745cd response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40802024-12-18T20:03:52.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9ad19d3b-856b-45c7-83c0-91f6ce5e6418 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40812024-12-18T20:03:52.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9ad19d3b-856b-45c7-83c0-91f6ce5e6418 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40822024-12-18T20:03:52.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9ad19d3b-856b-45c7-83c0-91f6ce5e6418 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
40832024-12-18T20:03:53.098ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34881
40842024-12-18T20:03:53.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34881 req_id = bbff30fb-1ee7-4ddd-8734-79e9f46b0db9 roles = RoleSet { roles: {} } uri = /metrics/producers
40852024-12-18T20:03:53.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34881 req_id = bbff30fb-1ee7-4ddd-8734-79e9f46b0db9 resource = Database result = Ok(()) uri = /metrics/producers
40862024-12-18T20:03:53.151ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = bca08b9a-1cac-41a6-8b38-a39f5fb70f29
40872024-12-18T20:03:53.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52361 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34881 req_id = bbff30fb-1ee7-4ddd-8734-79e9f46b0db9 response_code = 201 uri = /metrics/producers
40882024-12-18T20:03:53.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
40892024-12-18T20:03:53.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40902024-12-18T20:03:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40912024-12-18T20:03:53.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
40922024-12-18T20:03:53.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40932024-12-18T20:03:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40942024-12-18T20:03:53.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40952024-12-18T20:03:53.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40962024-12-18T20:03:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40972024-12-18T20:03:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40982024-12-18T20:03:53.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40992024-12-18T20:03:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41002024-12-18T20:03:53.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.182146ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41012024-12-18T20:03:53.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41022024-12-18T20:03:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41032024-12-18T20:03:53.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41042024-12-18T20:03:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
41052024-12-18T20:03:53.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41062024-12-18T20:03:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41072024-12-18T20:03:53.616ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
41082024-12-18T20:03:53.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.015042ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
41092024-12-18T20:03:53.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ace8eac3-212d-4d38-b9a3-d4e2a582cffb roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41102024-12-18T20:03:53.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ace8eac3-212d-4d38-b9a3-d4e2a582cffb resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41112024-12-18T20:03:53.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ace8eac3-212d-4d38-b9a3-d4e2a582cffb response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41122024-12-18T20:03:54.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1304 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = a83a8c2b-4337-4efb-8db4-a5987da83b09 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
41132024-12-18T20:03:54.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 4f6fa481-54e0-4ea6-82ec-6145e199cde2 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41142024-12-18T20:03:54.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 4f6fa481-54e0-4ea6-82ec-6145e199cde2 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41152024-12-18T20:03:54.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 4f6fa481-54e0-4ea6-82ec-6145e199cde2 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41162024-12-18T20:03:55.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e3b9569a-5ca2-4b77-b73f-67bfeeb8e74c roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41172024-12-18T20:03:55.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e3b9569a-5ca2-4b77-b73f-67bfeeb8e74c resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41182024-12-18T20:03:55.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e3b9569a-5ca2-4b77-b73f-67bfeeb8e74c response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41192024-12-18T20:03:56.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 4c34504b-6337-4161-87b3-3e868ead811d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41202024-12-18T20:03:56.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 4c34504b-6337-4161-87b3-3e868ead811d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41212024-12-18T20:03:56.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 4c34504b-6337-4161-87b3-3e868ead811d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41222024-12-18T20:03:57.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8f5789b9-3b0e-4446-868d-75a304ae5040 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41232024-12-18T20:03:57.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8f5789b9-3b0e-4446-868d-75a304ae5040 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41242024-12-18T20:03:57.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 8f5789b9-3b0e-4446-868d-75a304ae5040 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41252024-12-18T20:03:58.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ee3e9f3e-ae33-43fe-b007-67cca8db57bd roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41262024-12-18T20:03:58.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ee3e9f3e-ae33-43fe-b007-67cca8db57bd resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41272024-12-18T20:03:58.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ee3e9f3e-ae33-43fe-b007-67cca8db57bd response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41282024-12-18T20:03:59.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 0dec856d-b3c9-4fa9-b5d6-912cf74060cf roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
41292024-12-18T20:03:59.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 0dec856d-b3c9-4fa9-b5d6-912cf74060cf resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
41302024-12-18T20:03:59.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 0dec856d-b3c9-4fa9-b5d6-912cf74060cf response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
41312024-12-18T20:03:59.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 90713a5d-1e48-4429-95e4-f1a21a5394a8 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
41322024-12-18T20:03:59.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 90713a5d-1e48-4429-95e4-f1a21a5394a8 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
41332024-12-18T20:03:59.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 90713a5d-1e48-4429-95e4-f1a21a5394a8 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
41342024-12-18T20:03:59.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7b535e55-ddbd-4978-be38-a14c3b552c69 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41352024-12-18T20:03:59.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7b535e55-ddbd-4978-be38-a14c3b552c69 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41362024-12-18T20:03:59.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7b535e55-ddbd-4978-be38-a14c3b552c69 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41372024-12-18T20:04:00.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a6530bcd-5fa7-4a8f-9dd1-950f09809fcc roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41382024-12-18T20:04:00.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a6530bcd-5fa7-4a8f-9dd1-950f09809fcc resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41392024-12-18T20:04:00.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a6530bcd-5fa7-4a8f-9dd1-950f09809fcc response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41402024-12-18T20:04:01.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bbab74f0-336e-424b-84fb-51f5dfbcb879 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41412024-12-18T20:04:01.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bbab74f0-336e-424b-84fb-51f5dfbcb879 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41422024-12-18T20:04:01.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bbab74f0-336e-424b-84fb-51f5dfbcb879 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41432024-12-18T20:04:03.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ba83b2aa-65a4-49ee-9204-45fb6d4b804f roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41442024-12-18T20:04:03.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ba83b2aa-65a4-49ee-9204-45fb6d4b804f resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41452024-12-18T20:04:03.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ba83b2aa-65a4-49ee-9204-45fb6d4b804f response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
41462024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 32 reason = Timeout
41472024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41482024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 32 reason = Timeout
41492024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 32 reason = Timeout
41502024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 94 reason = Timeout
41512024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41522024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41532024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41542024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41552024-12-18T20:04:03.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41562024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
41572024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 32 reason = Timeout
41582024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 94 reason = Timeout
41592024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41602024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 32 reason = Timeout
41612024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41622024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 36 reason = Timeout
41632024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41642024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41652024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 32 reason = Timeout
41662024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41672024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41682024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
41692024-12-18T20:04:03.597ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41702024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41712024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 32 reason = Timeout
41722024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41732024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 32 reason = Timeout
41742024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41752024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 32 reason = Timeout
41762024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 32 reason = Timeout
41772024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41782024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41792024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 32 reason = Timeout
41802024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41812024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41822024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 32 reason = Timeout
41832024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41842024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41852024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41862024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41872024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41882024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41892024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41902024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41912024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41922024-12-18T20:04:03.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41932024-12-18T20:04:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41942024-12-18T20:04:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41952024-12-18T20:04:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41962024-12-18T20:04:03.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41972024-12-18T20:04:03.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41982024-12-18T20:04:03.598ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1918, tv_nsec: 886246090 } })
41992024-12-18T20:04:03.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
42002024-12-18T20:04:03.600ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.841368ms iteration = 32 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42012024-12-18T20:04:03.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1918, tv_nsec: 888127188 } })
42022024-12-18T20:04:03.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42032024-12-18T20:04:03.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
42042024-12-18T20:04:03.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42052024-12-18T20:04:03.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42062024-12-18T20:04:03.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42072024-12-18T20:04:03.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42082024-12-18T20:04:03.603ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42092024-12-18T20:04:03.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42102024-12-18T20:04:03.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42112024-12-18T20:04:03.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42122024-12-18T20:04:03.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42132024-12-18T20:04:03.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42142024-12-18T20:04:03.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42152024-12-18T20:04:03.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42162024-12-18T20:04:03.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42172024-12-18T20:04:03.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42182024-12-18T20:04:03.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42192024-12-18T20:04:03.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42202024-12-18T20:04:03.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42212024-12-18T20:04:03.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42222024-12-18T20:04:03.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.132337ms iteration = 32 status = {"errors":[],"garbage_collect_requested":[]}
42232024-12-18T20:04:03.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42242024-12-18T20:04:03.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42252024-12-18T20:04:03.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42262024-12-18T20:04:03.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42272024-12-18T20:04:03.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42282024-12-18T20:04:03.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42292024-12-18T20:04:03.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42302024-12-18T20:04:03.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42312024-12-18T20:04:03.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42322024-12-18T20:04:03.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42332024-12-18T20:04:03.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42342024-12-18T20:04:03.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42352024-12-18T20:04:03.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42362024-12-18T20:04:03.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42372024-12-18T20:04:03.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.694482ms iteration = 32 status = {"errors":[],"records_set_to_done":[]}
42382024-12-18T20:04:03.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.966069ms iteration = 94 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42392024-12-18T20:04:03.619ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42402024-12-18T20:04:03.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42412024-12-18T20:04:03.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42422024-12-18T20:04:03.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42432024-12-18T20:04:03.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42442024-12-18T20:04:03.621ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-58ee29db-9185-4216-97e8-559d204ec1d2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1918, tv_nsec: 909460747 } })
42452024-12-18T20:04:03.622ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
42462024-12-18T20:04:03.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42472024-12-18T20:04:03.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42482024-12-18T20:04:03.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42492024-12-18T20:04:03.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42502024-12-18T20:04:03.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42512024-12-18T20:04:03.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 28.819963ms iteration = 32 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42522024-12-18T20:04:03.627ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42532024-12-18T20:04:03.627ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 30.470006ms iteration = 32 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42542024-12-18T20:04:03.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42552024-12-18T20:04:03.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42562024-12-18T20:04:03.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42572024-12-18T20:04:03.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
42582024-12-18T20:04:03.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42592024-12-18T20:04:03.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42602024-12-18T20:04:03.642ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
42612024-12-18T20:04:03.642ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.1504ms iteration = 94 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
42622024-12-18T20:04:03.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42632024-12-18T20:04:03.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42642024-12-18T20:04:03.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42652024-12-18T20:04:03.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42662024-12-18T20:04:03.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42672024-12-18T20:04:03.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 58ee29db-9185-4216-97e8-559d204ec1d2, lookup_type: ById(58ee29db-9185-4216-97e8-559d204ec1d2) } result = Ok(())
42682024-12-18T20:04:03.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42692024-12-18T20:04:03.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42702024-12-18T20:04:03.656ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.198927ms iteration = 32 status = 0
42712024-12-18T20:04:03.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.822742ms iteration = 32 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42722024-12-18T20:04:03.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42732024-12-18T20:04:03.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42742024-12-18T20:04:03.676ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42752024-12-18T20:04:03.676ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42762024-12-18T20:04:03.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42772024-12-18T20:04:03.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42782024-12-18T20:04:03.678ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42792024-12-18T20:04:03.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42802024-12-18T20:04:03.680ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42812024-12-18T20:04:03.680ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42822024-12-18T20:04:03.680ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42832024-12-18T20:04:03.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42842024-12-18T20:04:03.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.673781ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42852024-12-18T20:04:03.684ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 87.363007ms iteration = 36 status = {"physical_disks_added":0}
42862024-12-18T20:04:03.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
42872024-12-18T20:04:03.685ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42882024-12-18T20:04:03.685ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf101aa6-9581-423e-81a6-762ac3dd20ef", "content-length": "26", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
42892024-12-18T20:04:03.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42902024-12-18T20:04:03.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42912024-12-18T20:04:03.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
42922024-12-18T20:04:03.688ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42932024-12-18T20:04:03.688ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1601c5b-9c6e-43a8-94af-1c2404b92a6f", "content-length": "26", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
42942024-12-18T20:04:03.688ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42952024-12-18T20:04:03.689ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42962024-12-18T20:04:03.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 zone_address = fd00:1122:3344:101::2
42972024-12-18T20:04:03.719ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42982024-12-18T20:04:03.719ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "30234c43-4766-4b32-b8f0-d9abe421b130", "content-length": "26", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
42992024-12-18T20:04:03.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43002024-12-18T20:04:03.720ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
43012024-12-18T20:04:03.727ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43022024-12-18T20:04:03.727ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43032024-12-18T20:04:03.727ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.392762ms iteration = 32 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43042024-12-18T20:04:03.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43052024-12-18T20:04:03.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43062024-12-18T20:04:03.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43072024-12-18T20:04:03.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43082024-12-18T20:04:03.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43092024-12-18T20:04:03.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43102024-12-18T20:04:03.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43112024-12-18T20:04:03.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43122024-12-18T20:04:03.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43132024-12-18T20:04:03.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43142024-12-18T20:04:03.827ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43152024-12-18T20:04:03.827ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43162024-12-18T20:04:03.828ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "27166977-0061-4e55-90b8-e08ef07245c4", "content-length": "372", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43172024-12-18T20:04:03.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43182024-12-18T20:04:03.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43192024-12-18T20:04:03.883ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
43202024-12-18T20:04:03.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43212024-12-18T20:04:03.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0590622b-96a0-43a1-8956-82bc8f6e5732", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43222024-12-18T20:04:03.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43232024-12-18T20:04:03.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43242024-12-18T20:04:03.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43252024-12-18T20:04:03.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43262024-12-18T20:04:03.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43272024-12-18T20:04:03.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43282024-12-18T20:04:03.892ZINFOnexus (BackgroundTasks): VPC route manager sled 58ee29db-9185-4216-97e8-559d204ec1d2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43292024-12-18T20:04:03.892ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43302024-12-18T20:04:03.892ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fed52976-090a-4276-8e3b-a2d0563b12fc", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43312024-12-18T20:04:03.894ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.640472ms iteration = 34 status = {}
43322024-12-18T20:04:03.905ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43332024-12-18T20:04:03.906ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a6df06b-46fd-4bb5-b8cd-767f6c6ad4f2", "content-length": "2", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43342024-12-18T20:04:03.907ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43352024-12-18T20:04:03.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43362024-12-18T20:04:03.911ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 315.329956ms iteration = 32 status = {}
43372024-12-18T20:04:03.916ZDEBGnexus (BackgroundTasks): client request SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43382024-12-18T20:04:03.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 58ee29db-9185-4216-97e8-559d204ec1d2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b74a0285-1080-4baa-8319-9c6cf999e014", "content-length": "691", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43392024-12-18T20:04:03.916ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
43402024-12-18T20:04:03.916ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
43412024-12-18T20:04:03.916ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
43422024-12-18T20:04:03.918ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 321.572865ms iteration = 33 status = {}
43432024-12-18T20:04:03.919ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 322.862861ms iteration = 32 status = null
43442024-12-18T20:04:03.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43452024-12-18T20:04:03.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43462024-12-18T20:04:03.951ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c592ee00-6719-4702-903e-a4aee00a8af1, rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(37c692d6-efbe-4d30-b3c8-683fe7cd5daa) } rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
43472024-12-18T20:04:03.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43482024-12-18T20:04:03.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43492024-12-18T20:04:03.960ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43502024-12-18T20:04:03.961ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "01e92513-e8e2-4447-b1d4-1be90c36206f", "content-length": "134", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43512024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43522024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 37c692d6-efbe-4d30-b3c8-683fe7cd5daa
43532024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43542024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43552024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43562024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43572024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43582024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43592024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43602024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43612024-12-18T20:04:03.961ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5
43622024-12-18T20:04:03.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43632024-12-18T20:04:03.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43642024-12-18T20:04:03.963ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43652024-12-18T20:04:03.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e106dd5-5a37-4bc7-ba7e-8ae9d78ac28f", "content-length": "2", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43662024-12-18T20:04:03.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
43672024-12-18T20:04:03.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9156a966-715c-484d-a40a-4cf112384d3e", "content-length": "52", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43682024-12-18T20:04:03.964ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch_location = Switch0
43692024-12-18T20:04:03.964ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43702024-12-18T20:04:04.056ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b02fa32b-df75-4eee-85a3-607d57684818", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43712024-12-18T20:04:04.057ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 switch = Switch0
43722024-12-18T20:04:04.057ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43732024-12-18T20:04:04.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 59f8769e-24e5-404c-807f-608424fea97b roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43742024-12-18T20:04:04.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 59f8769e-24e5-404c-807f-608424fea97b resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43752024-12-18T20:04:04.057ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 460eefc4-cff7-4f04-b6cb-c443459a12a5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ea88928-42b1-4b2f-9a41-482e96c9c73e", "content-length": "682", "date": "Wed, 18 Dec 2024 20:04:03 GMT"} })
43762024-12-18T20:04:04.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43772024-12-18T20:04:04.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43782024-12-18T20:04:04.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 59f8769e-24e5-404c-807f-608424fea97b response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43792024-12-18T20:04:04.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43802024-12-18T20:04:04.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43812024-12-18T20:04:04.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43822024-12-18T20:04:04.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43832024-12-18T20:04:04.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43842024-12-18T20:04:04.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43852024-12-18T20:04:04.073ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 476.502791ms iteration = 32 status = {}
43862024-12-18T20:04:04.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1270 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = d99f75d1-a34b-47e3-9214-f3a4df0ce38f response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
43872024-12-18T20:04:05.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ac8c6fa0-1876-44c1-ae83-1d7dbfe53d12 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43882024-12-18T20:04:05.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ac8c6fa0-1876-44c1-ae83-1d7dbfe53d12 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43892024-12-18T20:04:05.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ac8c6fa0-1876-44c1-ae83-1d7dbfe53d12 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43902024-12-18T20:04:06.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 796b3ebc-e2bd-430a-993c-2793d519a720 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43912024-12-18T20:04:06.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 796b3ebc-e2bd-430a-993c-2793d519a720 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43922024-12-18T20:04:06.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 796b3ebc-e2bd-430a-993c-2793d519a720 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43932024-12-18T20:04:07.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ed2da60f-f5b5-4657-83c2-34edbb693eca roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43942024-12-18T20:04:07.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ed2da60f-f5b5-4657-83c2-34edbb693eca resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43952024-12-18T20:04:07.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ed2da60f-f5b5-4657-83c2-34edbb693eca response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43962024-12-18T20:04:08.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 159f2429-3f3c-482d-981d-b965c8d4b672 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43972024-12-18T20:04:08.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 159f2429-3f3c-482d-981d-b965c8d4b672 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43982024-12-18T20:04:08.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 159f2429-3f3c-482d-981d-b965c8d4b672 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
43992024-12-18T20:04:09.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0f3c77bc-5059-4a98-a01b-655618e48dee roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44002024-12-18T20:04:09.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0f3c77bc-5059-4a98-a01b-655618e48dee resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44012024-12-18T20:04:09.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 0f3c77bc-5059-4a98-a01b-655618e48dee response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44022024-12-18T20:04:10.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10930c28-cd84-494f-ad82-b115095cdaed roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44032024-12-18T20:04:10.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10930c28-cd84-494f-ad82-b115095cdaed resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44042024-12-18T20:04:10.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10930c28-cd84-494f-ad82-b115095cdaed response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44052024-12-18T20:04:11.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b8042981-b74a-47e2-beea-16a217e32eaa roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44062024-12-18T20:04:11.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b8042981-b74a-47e2-beea-16a217e32eaa resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44072024-12-18T20:04:11.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b8042981-b74a-47e2-beea-16a217e32eaa response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44082024-12-18T20:04:12.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10f833eb-e1c7-4788-b77b-ed589a278f49 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44092024-12-18T20:04:12.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10f833eb-e1c7-4788-b77b-ed589a278f49 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44102024-12-18T20:04:12.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 10f833eb-e1c7-4788-b77b-ed589a278f49 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44112024-12-18T20:04:13.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bc1d780c-1c44-4630-860b-8b923d2e151f roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44122024-12-18T20:04:13.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bc1d780c-1c44-4630-860b-8b923d2e151f resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44132024-12-18T20:04:13.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = bc1d780c-1c44-4630-860b-8b923d2e151f response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44142024-12-18T20:04:13.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 95 reason = Timeout
44152024-12-18T20:04:13.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44162024-12-18T20:04:13.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44172024-12-18T20:04:13.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 95 reason = Timeout
44182024-12-18T20:04:13.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44192024-12-18T20:04:13.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44202024-12-18T20:04:13.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44212024-12-18T20:04:13.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44222024-12-18T20:04:13.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44232024-12-18T20:04:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44242024-12-18T20:04:13.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44252024-12-18T20:04:13.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44262024-12-18T20:04:13.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.849989ms iteration = 95 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44272024-12-18T20:04:13.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44282024-12-18T20:04:13.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44292024-12-18T20:04:13.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44302024-12-18T20:04:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
44312024-12-18T20:04:13.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44322024-12-18T20:04:13.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44332024-12-18T20:04:13.617ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
44342024-12-18T20:04:13.617ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.975822ms iteration = 95 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
44352024-12-18T20:04:14.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = aab18996-8b0b-45ba-8d46-8fac90c73486 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44362024-12-18T20:04:14.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = aab18996-8b0b-45ba-8d46-8fac90c73486 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44372024-12-18T20:04:14.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = aab18996-8b0b-45ba-8d46-8fac90c73486 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44382024-12-18T20:04:14.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1373 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 686a9509-b1ba-44a5-90c9-42474bd18ded response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
44392024-12-18T20:04:15.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 02c28976-363a-4954-b714-72f5216fae6a roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44402024-12-18T20:04:15.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 02c28976-363a-4954-b714-72f5216fae6a resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44412024-12-18T20:04:15.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 02c28976-363a-4954-b714-72f5216fae6a response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44422024-12-18T20:04:16.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e4a726dc-1a5d-4285-9168-c21f1f654695 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44432024-12-18T20:04:16.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e4a726dc-1a5d-4285-9168-c21f1f654695 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44442024-12-18T20:04:16.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2686 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = e4a726dc-1a5d-4285-9168-c21f1f654695 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44452024-12-18T20:04:17.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b6daa3d0-c0ef-4f89-a970-63140a6d760d roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44462024-12-18T20:04:17.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b6daa3d0-c0ef-4f89-a970-63140a6d760d resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44472024-12-18T20:04:17.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b6daa3d0-c0ef-4f89-a970-63140a6d760d response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44482024-12-18T20:04:18.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c6f42ad1-aeba-4a92-bdce-59262c2bc8df roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44492024-12-18T20:04:18.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c6f42ad1-aeba-4a92-bdce-59262c2bc8df resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44502024-12-18T20:04:18.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c6f42ad1-aeba-4a92-bdce-59262c2bc8df response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44512024-12-18T20:04:19.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5ae0e15c-5bf5-4430-8643-cea3f34e6dbe roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44522024-12-18T20:04:19.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5ae0e15c-5bf5-4430-8643-cea3f34e6dbe resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44532024-12-18T20:04:19.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 5ae0e15c-5bf5-4430-8643-cea3f34e6dbe response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44542024-12-18T20:04:20.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ab9cbac5-7992-4bcb-b6c9-7168ab725d65 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44552024-12-18T20:04:20.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ab9cbac5-7992-4bcb-b6c9-7168ab725d65 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44562024-12-18T20:04:20.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = ab9cbac5-7992-4bcb-b6c9-7168ab725d65 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44572024-12-18T20:04:21.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7e106047-2738-444a-8edf-8ac47d522af7 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44582024-12-18T20:04:21.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7e106047-2738-444a-8edf-8ac47d522af7 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44592024-12-18T20:04:21.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 7e106047-2738-444a-8edf-8ac47d522af7 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44602024-12-18T20:04:22.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 51252efc-3b6e-43a7-b2f7-a191408b3e13 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44612024-12-18T20:04:22.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 51252efc-3b6e-43a7-b2f7-a191408b3e13 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44622024-12-18T20:04:22.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 51252efc-3b6e-43a7-b2f7-a191408b3e13 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44632024-12-18T20:04:23.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a5b7396b-f27b-43dd-ad5a-b19b214822fd roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44642024-12-18T20:04:23.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a5b7396b-f27b-43dd-ad5a-b19b214822fd resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44652024-12-18T20:04:23.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = a5b7396b-f27b-43dd-ad5a-b19b214822fd response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44662024-12-18T20:04:23.596ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 96 reason = Timeout
44672024-12-18T20:04:23.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44682024-12-18T20:04:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44692024-12-18T20:04:23.597ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 96 reason = Timeout
44702024-12-18T20:04:23.597ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44712024-12-18T20:04:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44722024-12-18T20:04:23.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44732024-12-18T20:04:23.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44742024-12-18T20:04:23.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44752024-12-18T20:04:23.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.747737ms iteration = 96 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44762024-12-18T20:04:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44772024-12-18T20:04:23.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44782024-12-18T20:04:23.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44792024-12-18T20:04:23.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44802024-12-18T20:04:23.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44812024-12-18T20:04:23.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44822024-12-18T20:04:23.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d09d03cc-cc4e-402b-84e7-f281bc270e66, lookup_type: ById(d09d03cc-cc4e-402b-84e7-f281bc270e66) } result = Ok(())
44832024-12-18T20:04:23.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44842024-12-18T20:04:23.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44852024-12-18T20:04:23.615ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 original_time_created = 2024-12-18 19:48:22.577513 UTC target_id = d09d03cc-cc4e-402b-84e7-f281bc270e66 time_created = 2024-12-18 19:48:22.577513 UTC
44862024-12-18T20:04:23.615ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.203375ms iteration = 96 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d09d03cc-cc4e-402b-84e7-f281bc270e66","time_created":"2024-12-18T19:48:22.577513Z"}
44872024-12-18T20:04:24.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c7392dc3-f66c-4a2a-845b-67aa13ec5750 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44882024-12-18T20:04:24.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c7392dc3-f66c-4a2a-845b-67aa13ec5750 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44892024-12-18T20:04:24.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = c7392dc3-f66c-4a2a-845b-67aa13ec5750 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44902024-12-18T20:04:24.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1302 local_addr = [fd00:1122:3344:101::b]:59641 method = GET remote_addr = [fd00:1122:3344:101::d]:39661 req_id = 197ed48f-4af1-4764-9225-ff394138cb02 response_code = 200 uri = /1139ebda-6055-49a8-8243-f0019044de70
44912024-12-18T20:04:25.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b9817cfb-adba-4c32-a57a-0b26edc957a3 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44922024-12-18T20:04:25.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b9817cfb-adba-4c32-a57a-0b26edc957a3 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44932024-12-18T20:04:25.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = b9817cfb-adba-4c32-a57a-0b26edc957a3 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44942024-12-18T20:04:26.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f88e78b1-ceff-4e08-bfa0-5d76f7c9d071 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44952024-12-18T20:04:26.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f88e78b1-ceff-4e08-bfa0-5d76f7c9d071 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44962024-12-18T20:04:26.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = f88e78b1-ceff-4e08-bfa0-5d76f7c9d071 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44972024-12-18T20:04:27.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9eda3900-f092-48f9-aaab-05126f11c7f1 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44982024-12-18T20:04:27.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9eda3900-f092-48f9-aaab-05126f11c7f1 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
44992024-12-18T20:04:27.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 9eda3900-f092-48f9-aaab-05126f11c7f1 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
45002024-12-18T20:04:28.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 84b95d90-1d76-4452-82a5-363be760e180 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
45012024-12-18T20:04:28.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 84b95d90-1d76-4452-82a5-363be760e180 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
45022024-12-18T20:04:28.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 84b95d90-1d76-4452-82a5-363be760e180 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
45032024-12-18T20:04:29.262ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:43026
45042024-12-18T20:04:29.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43026 req_id = 496544d3-af9e-47ce-8764-16a872279b90 roles = RoleSet { roles: {} } uri = /metrics/producers
45052024-12-18T20:04:29.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43026 req_id = 496544d3-af9e-47ce-8764-16a872279b90 resource = Database result = Ok(()) uri = /metrics/producers
45062024-12-18T20:04:29.312ZINFOnexus: assigned collector to new producer collector_id = 2a7637c0-f465-4032-a837-76ff2b185388 file = nexus/src/app/oximeter.rs:76 producer_id = 6e435600-9709-41f3-aa5a-2e4931ba547c
45072024-12-18T20:04:29.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49441 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43026 req_id = 496544d3-af9e-47ce-8764-16a872279b90 response_code = 201 uri = /metrics/producers
45082024-12-18T20:04:29.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = a84339fb-fffb-4480-b97f-4765971516b2 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
45092024-12-18T20:04:29.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = a84339fb-fffb-4480-b97f-4765971516b2 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
45102024-12-18T20:04:29.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = a84339fb-fffb-4480-b97f-4765971516b2 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?sort_by=id_ascending
45112024-12-18T20:04:29.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 569018a5-d6f7-4e1f-8615-bcd9d40618f4 roles = RoleSet { roles: {} } uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
45122024-12-18T20:04:29.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 569018a5-d6f7-4e1f-8615-bcd9d40618f4 resource = Database result = Ok(()) uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
45132024-12-18T20:04:29.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59952 req_id = 569018a5-d6f7-4e1f-8615-bcd9d40618f4 response_code = 200 uri = /metrics/collectors/2a7637c0-f465-4032-a837-76ff2b185388/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYzY2ZGVkYi01ZDkyLTRlZjktOTE5NS03ZGZlMDAwMGMwMGEifX0%3D
45142024-12-18T20:04:29.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1b686c52-3184-4e55-8565-560ab0015c29 roles = RoleSet { roles: {} } uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
45152024-12-18T20:04:29.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1b686c52-3184-4e55-8565-560ab0015c29 resource = Database result = Ok(()) uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2
45162024-12-18T20:04:29.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1b686c52-3184-4e55-8565-560ab0015c29 response_code = 200 uri = /probes/58ee29db-9185-4216-97e8-559d204ec1d2