Max level shown:
12024-09-23T23:15:02.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f14d7c22-a097-4d94-9c7d-bebd64196e3e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22024-09-23T23:15:02.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f14d7c22-a097-4d94-9c7d-bebd64196e3e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32024-09-23T23:15:02.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f14d7c22-a097-4d94-9c7d-bebd64196e3e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
42024-09-23T23:15:03.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e6dead1a-96c6-4987-8956-ed1ba32ec810 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52024-09-23T23:15:03.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e6dead1a-96c6-4987-8956-ed1ba32ec810 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62024-09-23T23:15:03.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e6dead1a-96c6-4987-8956-ed1ba32ec810 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
72024-09-23T23:15:04.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b4eb07ef-325c-4c9c-a667-71220b9f6571 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
82024-09-23T23:15:04.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b4eb07ef-325c-4c9c-a667-71220b9f6571 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
92024-09-23T23:15:04.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b4eb07ef-325c-4c9c-a667-71220b9f6571 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
102024-09-23T23:15:05.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 21029935-27fb-43eb-8214-19e34665a385 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
112024-09-23T23:15:05.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 21029935-27fb-43eb-8214-19e34665a385 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
122024-09-23T23:15:05.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 21029935-27fb-43eb-8214-19e34665a385 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
132024-09-23T23:15:05.988ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1433 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 253e585e-a0ed-49a6-a677-2e046ae2f296 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
142024-09-23T23:15:06.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7c825558-5e05-4ba9-b59e-9b744f3da583 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
152024-09-23T23:15:06.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7c825558-5e05-4ba9-b59e-9b744f3da583 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
162024-09-23T23:15:06.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7c825558-5e05-4ba9-b59e-9b744f3da583 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
172024-09-23T23:15:07.800ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
182024-09-23T23:15:07.800ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
192024-09-23T23:15:07.800ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
202024-09-23T23:15:07.800ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
212024-09-23T23:15:07.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
222024-09-23T23:15:07.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
232024-09-23T23:15:07.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
242024-09-23T23:15:07.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
252024-09-23T23:15:07.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
262024-09-23T23:15:07.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
272024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
282024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
292024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
302024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
312024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
322024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
332024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
342024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
352024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
362024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
372024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
382024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
392024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
402024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
412024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
422024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
432024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
442024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
452024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
462024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
472024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
482024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
492024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
502024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
512024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
522024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
532024-09-23T23:15:07.803ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1107, tv_nsec: 690512049 } })
542024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
552024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
562024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
572024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
582024-09-23T23:15:07.803ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1107, tv_nsec: 690576610 } })
592024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
602024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
612024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
622024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
632024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
642024-09-23T23:15:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
652024-09-23T23:15:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
662024-09-23T23:15:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
672024-09-23T23:15:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
682024-09-23T23:15:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
692024-09-23T23:15:07.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
702024-09-23T23:15:07.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
712024-09-23T23:15:07.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
722024-09-23T23:15:07.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
732024-09-23T23:15:07.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
742024-09-23T23:15:07.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
752024-09-23T23:15:07.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
762024-09-23T23:15:07.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
772024-09-23T23:15:07.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
782024-09-23T23:15:07.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
792024-09-23T23:15:07.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
802024-09-23T23:15:07.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
812024-09-23T23:15:07.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
822024-09-23T23:15:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
832024-09-23T23:15:07.810ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
842024-09-23T23:15:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
852024-09-23T23:15:07.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
862024-09-23T23:15:07.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
872024-09-23T23:15:07.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
882024-09-23T23:15:07.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
892024-09-23T23:15:07.813ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
902024-09-23T23:15:07.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
912024-09-23T23:15:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
922024-09-23T23:15:07.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
932024-09-23T23:15:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
942024-09-23T23:15:07.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
952024-09-23T23:15:07.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
962024-09-23T23:15:07.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
972024-09-23T23:15:07.817ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
982024-09-23T23:15:07.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
992024-09-23T23:15:07.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.91269ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
1002024-09-23T23:15:07.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1012024-09-23T23:15:07.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1022024-09-23T23:15:07.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1032024-09-23T23:15:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1042024-09-23T23:15:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1052024-09-23T23:15:07.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 16.255418ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1062024-09-23T23:15:07.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1072024-09-23T23:15:07.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1082024-09-23T23:15:07.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1092024-09-23T23:15:07.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1102024-09-23T23:15:07.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1112024-09-23T23:15:07.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1107, tv_nsec: 708709469 } })
1122024-09-23T23:15:07.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1132024-09-23T23:15:07.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
1142024-09-23T23:15:07.825ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1152024-09-23T23:15:07.825ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.561709ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1162024-09-23T23:15:07.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
1172024-09-23T23:15:07.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1182024-09-23T23:15:07.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1192024-09-23T23:15:07.834ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
1202024-09-23T23:15:07.834ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.325983ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
1212024-09-23T23:15:07.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.260481ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
1222024-09-23T23:15:07.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1232024-09-23T23:15:07.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1242024-09-23T23:15:07.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1252024-09-23T23:15:07.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1262024-09-23T23:15:07.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1272024-09-23T23:15:07.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1282024-09-23T23:15:07.861ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1292024-09-23T23:15:07.861ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1302024-09-23T23:15:07.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1312024-09-23T23:15:07.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1322024-09-23T23:15:07.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1332024-09-23T23:15:07.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1342024-09-23T23:15:07.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1352024-09-23T23:15:07.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1362024-09-23T23:15:07.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1372024-09-23T23:15:07.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1382024-09-23T23:15:07.912ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 110.726266ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1392024-09-23T23:15:07.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1402024-09-23T23:15:07.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1412024-09-23T23:15:07.960ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1422024-09-23T23:15:07.962ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6e684d58-1c97-4e2e-af41-6aad5a8537f9", "content-length": "372", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
1432024-09-23T23:15:07.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1442024-09-23T23:15:07.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1452024-09-23T23:15:07.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 160.212227ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1462024-09-23T23:15:07.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1472024-09-23T23:15:07.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1482024-09-23T23:15:07.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1492024-09-23T23:15:07.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1502024-09-23T23:15:07.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1512024-09-23T23:15:07.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1522024-09-23T23:15:07.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1532024-09-23T23:15:07.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
1542024-09-23T23:15:07.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1552024-09-23T23:15:07.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1562024-09-23T23:15:07.976ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 173.350998ms iteration = 6 status = 0
1572024-09-23T23:15:07.976ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1582024-09-23T23:15:07.977ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "87b39f31-cefb-4e5e-ae24-3f3a9cddcb10", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
1592024-09-23T23:15:07.979ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 175.666005ms iteration = 7 status = {}
1602024-09-23T23:15:07.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 87ee7198-7b68-412d-9858-53f7cdc4d8c0 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
1612024-09-23T23:15:07.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 87ee7198-7b68-412d-9858-53f7cdc4d8c0 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
1622024-09-23T23:15:07.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 87ee7198-7b68-412d-9858-53f7cdc4d8c0 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
1632024-09-23T23:15:08.001ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1642024-09-23T23:15:08.001ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1652024-09-23T23:15:08.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1662024-09-23T23:15:08.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1672024-09-23T23:15:08.004ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 201.073397ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1682024-09-23T23:15:08.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 210.988652ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1692024-09-23T23:15:08.034ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1702024-09-23T23:15:08.034ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1712024-09-23T23:15:08.034ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 230.889372ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1722024-09-23T23:15:08.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1732024-09-23T23:15:08.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1742024-09-23T23:15:08.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1752024-09-23T23:15:08.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1762024-09-23T23:15:08.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1772024-09-23T23:15:08.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1782024-09-23T23:15:08.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792024-09-23T23:15:08.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1802024-09-23T23:15:08.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1812024-09-23T23:15:08.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1822024-09-23T23:15:08.096ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
1832024-09-23T23:15:08.096ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1842024-09-23T23:15:08.096ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c898181-92f8-4b6e-b614-63bb0a713730", "content-length": "26", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
1852024-09-23T23:15:08.096ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1862024-09-23T23:15:08.098ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1872024-09-23T23:15:08.111ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
1882024-09-23T23:15:08.111ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1892024-09-23T23:15:08.112ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "42c2172f-3a3d-4eae-9648-eccab5edc4d5", "content-length": "26", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
1902024-09-23T23:15:08.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1912024-09-23T23:15:08.114ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1922024-09-23T23:15:08.115ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 311.609431ms iteration = 9 status = {"physical_disks_added":0}
1932024-09-23T23:15:08.119ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
1942024-09-23T23:15:08.119ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1952024-09-23T23:15:08.120ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "315cb27b-edca-4e14-9cc7-1f15b130c5bd", "content-length": "26", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
1962024-09-23T23:15:08.120ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1972024-09-23T23:15:08.121ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
1982024-09-23T23:15:08.189ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
1992024-09-23T23:15:08.190ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "28d2bc56-5ae0-402a-8445-e570ef14f833", "content-length": "691", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
2002024-09-23T23:15:08.190ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2012024-09-23T23:15:08.190ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2022024-09-23T23:15:08.190ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2032024-09-23T23:15:08.191ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 387.959021ms iteration = 6 status = {}
2042024-09-23T23:15:08.194ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 393.94935ms iteration = 6 status = {}
2052024-09-23T23:15:08.201ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2062024-09-23T23:15:08.202ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8adb0a75-632f-4254-8eb1-0f6925d4b8a5", "content-length": "1", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
2072024-09-23T23:15:08.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2082024-09-23T23:15:08.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2092024-09-23T23:15:08.206ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 405.553404ms iteration = 6 status = null
2102024-09-23T23:15:08.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 673c1fa9-b8aa-4110-8546-fdd629760210 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2112024-09-23T23:15:08.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 673c1fa9-b8aa-4110-8546-fdd629760210 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2122024-09-23T23:15:08.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 673c1fa9-b8aa-4110-8546-fdd629760210 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2132024-09-23T23:15:08.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2142024-09-23T23:15:08.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2152024-09-23T23:15:08.267ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
2162024-09-23T23:15:08.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2172024-09-23T23:15:08.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2182024-09-23T23:15:08.277ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2192024-09-23T23:15:08.277ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eaff91e9-7ace-47d3-9edf-a85e7a2a174d", "content-length": "121", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
2202024-09-23T23:15:08.277ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
2212024-09-23T23:15:08.277ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
2222024-09-23T23:15:08.277ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2232024-09-23T23:15:08.277ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2242024-09-23T23:15:08.277ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
2252024-09-23T23:15:08.277ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
2262024-09-23T23:15:08.277ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
2272024-09-23T23:15:08.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2282024-09-23T23:15:08.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2292024-09-23T23:15:08.280ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2302024-09-23T23:15:08.280ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "86b64d69-da65-4937-8318-a02e3fcc4ab4", "content-length": "2", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
2312024-09-23T23:15:08.280ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2322024-09-23T23:15:08.280ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "312f5b80-4f1b-4695-9618-df700e10383f", "content-length": "52", "date": "Mon, 23 Sep 2024 23:15:07 GMT"} })
2332024-09-23T23:15:08.280ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
2342024-09-23T23:15:08.280ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2352024-09-23T23:15:08.428ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2edab997-939e-4f0c-b141-846de92f099e", "date": "Mon, 23 Sep 2024 23:15:08 GMT"} })
2362024-09-23T23:15:08.428ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
2372024-09-23T23:15:08.428ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2382024-09-23T23:15:08.428ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "17de8418-164a-48b8-ad9f-5f1db7f543da", "content-length": "667", "date": "Mon, 23 Sep 2024 23:15:08 GMT"} })
2392024-09-23T23:15:08.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2402024-09-23T23:15:08.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2412024-09-23T23:15:08.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2422024-09-23T23:15:08.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2432024-09-23T23:15:08.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2442024-09-23T23:15:08.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2452024-09-23T23:15:08.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2462024-09-23T23:15:08.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2472024-09-23T23:15:08.544ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 740.564045ms iteration = 6 status = {}
2482024-09-23T23:15:09.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2e9a1fd0-5302-499a-963b-cb13120eab18 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2492024-09-23T23:15:09.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2e9a1fd0-5302-499a-963b-cb13120eab18 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2502024-09-23T23:15:09.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2e9a1fd0-5302-499a-963b-cb13120eab18 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2512024-09-23T23:15:10.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ee8ef765-258e-45cc-940a-5a4532ec0600 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2522024-09-23T23:15:10.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ee8ef765-258e-45cc-940a-5a4532ec0600 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2532024-09-23T23:15:10.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ee8ef765-258e-45cc-940a-5a4532ec0600 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2542024-09-23T23:15:11.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62c784f4-32ed-403a-855d-38bab1efed13 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2552024-09-23T23:15:11.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62c784f4-32ed-403a-855d-38bab1efed13 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2562024-09-23T23:15:11.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62c784f4-32ed-403a-855d-38bab1efed13 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2572024-09-23T23:15:12.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0fee8f96-f5da-44d8-abcd-7d0ad8bcf64e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2582024-09-23T23:15:12.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0fee8f96-f5da-44d8-abcd-7d0ad8bcf64e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2592024-09-23T23:15:12.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0fee8f96-f5da-44d8-abcd-7d0ad8bcf64e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2602024-09-23T23:15:13.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9ec59512-d534-4d7e-b7b9-c8fc03f7862c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2612024-09-23T23:15:13.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9ec59512-d534-4d7e-b7b9-c8fc03f7862c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2622024-09-23T23:15:13.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9ec59512-d534-4d7e-b7b9-c8fc03f7862c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2632024-09-23T23:15:14.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d16879c6-eb0d-48ef-8fe7-83a21c3f545c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2642024-09-23T23:15:14.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d16879c6-eb0d-48ef-8fe7-83a21c3f545c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2652024-09-23T23:15:14.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d16879c6-eb0d-48ef-8fe7-83a21c3f545c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2662024-09-23T23:15:15.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ba8c65f4-e789-4d41-8a26-57c8946e241b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2672024-09-23T23:15:15.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ba8c65f4-e789-4d41-8a26-57c8946e241b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2682024-09-23T23:15:15.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ba8c65f4-e789-4d41-8a26-57c8946e241b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2692024-09-23T23:15:15.989ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1455 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 285b01ab-bedd-487e-a40b-cb7f986684ec response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
2702024-09-23T23:15:16.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bff28714-36ed-4b90-af2d-a60a2813ba52 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2712024-09-23T23:15:16.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bff28714-36ed-4b90-af2d-a60a2813ba52 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2722024-09-23T23:15:16.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bff28714-36ed-4b90-af2d-a60a2813ba52 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2732024-09-23T23:15:17.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 63680eec-0c82-4538-b30f-c39273061edf roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2742024-09-23T23:15:17.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 63680eec-0c82-4538-b30f-c39273061edf resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2752024-09-23T23:15:17.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 63680eec-0c82-4538-b30f-c39273061edf response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2762024-09-23T23:15:17.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
2772024-09-23T23:15:17.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2782024-09-23T23:15:17.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2792024-09-23T23:15:17.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
2802024-09-23T23:15:17.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2812024-09-23T23:15:17.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822024-09-23T23:15:17.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2832024-09-23T23:15:17.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2842024-09-23T23:15:17.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2852024-09-23T23:15:17.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2862024-09-23T23:15:17.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2872024-09-23T23:15:17.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2882024-09-23T23:15:17.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2892024-09-23T23:15:17.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
2902024-09-23T23:15:17.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2912024-09-23T23:15:17.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2922024-09-23T23:15:17.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
2932024-09-23T23:15:17.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.606226ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
2942024-09-23T23:15:17.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2952024-09-23T23:15:17.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2962024-09-23T23:15:17.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.630805ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2972024-09-23T23:15:18.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a7d3032a-84c4-4d98-be3e-e6f8e41992cf roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2982024-09-23T23:15:18.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a7d3032a-84c4-4d98-be3e-e6f8e41992cf resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
2992024-09-23T23:15:18.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1896 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a7d3032a-84c4-4d98-be3e-e6f8e41992cf response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3002024-09-23T23:15:19.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 36db182d-bb5f-4009-b76e-248324a2fb7d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3012024-09-23T23:15:19.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 36db182d-bb5f-4009-b76e-248324a2fb7d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3022024-09-23T23:15:19.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 36db182d-bb5f-4009-b76e-248324a2fb7d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3032024-09-23T23:15:20.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 76aec425-e2e5-4a33-b939-178816c36517 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3042024-09-23T23:15:20.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 76aec425-e2e5-4a33-b939-178816c36517 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3052024-09-23T23:15:20.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 76aec425-e2e5-4a33-b939-178816c36517 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3062024-09-23T23:15:21.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2f99f929-6c6a-4d1c-b9df-76f8ce51c588 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3072024-09-23T23:15:21.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2f99f929-6c6a-4d1c-b9df-76f8ce51c588 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3082024-09-23T23:15:21.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2f99f929-6c6a-4d1c-b9df-76f8ce51c588 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3092024-09-23T23:15:22.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f3f367c5-fd20-4da4-a49c-857399cd8103 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3102024-09-23T23:15:22.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f3f367c5-fd20-4da4-a49c-857399cd8103 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3112024-09-23T23:15:22.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f3f367c5-fd20-4da4-a49c-857399cd8103 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3122024-09-23T23:15:23.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d7a5feed-9429-4d5f-93d2-ed5d3d3b7b28 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3132024-09-23T23:15:23.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d7a5feed-9429-4d5f-93d2-ed5d3d3b7b28 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3142024-09-23T23:15:23.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d7a5feed-9429-4d5f-93d2-ed5d3d3b7b28 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3152024-09-23T23:15:24.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68ea3d9e-4ad7-4af4-bdd3-fe55cec67916 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3162024-09-23T23:15:24.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68ea3d9e-4ad7-4af4-bdd3-fe55cec67916 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3172024-09-23T23:15:24.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68ea3d9e-4ad7-4af4-bdd3-fe55cec67916 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3182024-09-23T23:15:25.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 804a695f-e9db-49c5-8d6b-3ce8704686a8 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3192024-09-23T23:15:25.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 804a695f-e9db-49c5-8d6b-3ce8704686a8 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3202024-09-23T23:15:25.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1796 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 804a695f-e9db-49c5-8d6b-3ce8704686a8 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3212024-09-23T23:15:25.959ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
3222024-09-23T23:15:25.959ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
3232024-09-23T23:15:25.990ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3242024-09-23T23:15:25.990ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:43239
3252024-09-23T23:15:25.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43239 req_id = 736646f9-ee5b-4684-8ece-80828a3dbcbd roles = RoleSet { roles: {} } uri = /metrics/producers
3262024-09-23T23:15:25.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43239 req_id = 736646f9-ee5b-4684-8ece-80828a3dbcbd resource = Database result = Ok(()) uri = /metrics/producers
3272024-09-23T23:15:25.991ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1406 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 327f7602-ff1d-4837-84cc-d95cfc19a25f response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
3282024-09-23T23:15:26.024ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
3292024-09-23T23:15:26.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43239 req_id = 736646f9-ee5b-4684-8ece-80828a3dbcbd roles = RoleSet { roles: {} } uri = /metrics/producers
3302024-09-23T23:15:26.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43239 req_id = 736646f9-ee5b-4684-8ece-80828a3dbcbd resource = Database result = Ok(()) uri = /metrics/producers
3312024-09-23T23:15:26.065ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
3322024-09-23T23:15:26.065ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f413b95f-216f-4b74-bc5c-e172cb4e7e6a", "date": "Mon, 23 Sep 2024 23:15:26 GMT"} })
3332024-09-23T23:15:26.065ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = 212442ce-6712-4c6a-beb4-26917e04679b
3342024-09-23T23:15:26.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 76155 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:43239 req_id = 736646f9-ee5b-4684-8ece-80828a3dbcbd response_code = 201 uri = /metrics/producers
3352024-09-23T23:15:26.066ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "736646f9-ee5b-4684-8ece-80828a3dbcbd", "content-length": "41", "date": "Mon, 23 Sep 2024 23:15:25 GMT"} })
3362024-09-23T23:15:26.067ZDEBGnexus (producer-registration-task): registered with nexus successfully
3372024-09-23T23:15:26.067ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
3382024-09-23T23:15:26.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1f36f13a-ef40-4690-af52-63cc9ea68ebe roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3392024-09-23T23:15:26.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1f36f13a-ef40-4690-af52-63cc9ea68ebe resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3402024-09-23T23:15:26.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1f36f13a-ef40-4690-af52-63cc9ea68ebe response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3412024-09-23T23:15:27.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6e55e1f3-5bf5-49b1-852d-3986728e4028 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3422024-09-23T23:15:27.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6e55e1f3-5bf5-49b1-852d-3986728e4028 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3432024-09-23T23:15:27.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6e55e1f3-5bf5-49b1-852d-3986728e4028 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3442024-09-23T23:15:27.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
3452024-09-23T23:15:27.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3462024-09-23T23:15:27.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3472024-09-23T23:15:27.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
3482024-09-23T23:15:27.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3492024-09-23T23:15:27.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3502024-09-23T23:15:27.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3512024-09-23T23:15:27.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3522024-09-23T23:15:27.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3532024-09-23T23:15:27.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3542024-09-23T23:15:27.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3552024-09-23T23:15:27.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3562024-09-23T23:15:27.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.656533ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3572024-09-23T23:15:27.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3582024-09-23T23:15:27.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3592024-09-23T23:15:27.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3602024-09-23T23:15:27.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
3612024-09-23T23:15:27.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3622024-09-23T23:15:27.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3632024-09-23T23:15:27.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
3642024-09-23T23:15:27.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.341963ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
3652024-09-23T23:15:28.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 80095c28-8dce-49bd-a821-dd5d53d9b863 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3662024-09-23T23:15:28.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 80095c28-8dce-49bd-a821-dd5d53d9b863 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3672024-09-23T23:15:28.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 80095c28-8dce-49bd-a821-dd5d53d9b863 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3682024-09-23T23:15:29.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5cea3771-9cef-4ba7-85da-3c8734a071ad roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3692024-09-23T23:15:29.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5cea3771-9cef-4ba7-85da-3c8734a071ad resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3702024-09-23T23:15:29.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5cea3771-9cef-4ba7-85da-3c8734a071ad response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3712024-09-23T23:15:30.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = efb42bdb-4eb8-4d95-97fc-0f1b49849549 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3722024-09-23T23:15:30.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = efb42bdb-4eb8-4d95-97fc-0f1b49849549 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3732024-09-23T23:15:30.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = efb42bdb-4eb8-4d95-97fc-0f1b49849549 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3742024-09-23T23:15:31.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cc39d8aa-6a7d-4e98-9732-de2f6c64b78b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3752024-09-23T23:15:31.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cc39d8aa-6a7d-4e98-9732-de2f6c64b78b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3762024-09-23T23:15:31.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cc39d8aa-6a7d-4e98-9732-de2f6c64b78b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3772024-09-23T23:15:32.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 42e64950-4d06-4190-9356-bc23cdf1d4cb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3782024-09-23T23:15:32.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 42e64950-4d06-4190-9356-bc23cdf1d4cb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3792024-09-23T23:15:32.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 42e64950-4d06-4190-9356-bc23cdf1d4cb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3802024-09-23T23:15:33.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c6ce4077-7be0-4348-b6c7-692b4d35d405 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3812024-09-23T23:15:33.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c6ce4077-7be0-4348-b6c7-692b4d35d405 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3822024-09-23T23:15:33.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c6ce4077-7be0-4348-b6c7-692b4d35d405 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3832024-09-23T23:15:34.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 92a3a060-48ed-4449-a19c-a1461ca2d623 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3842024-09-23T23:15:34.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 92a3a060-48ed-4449-a19c-a1461ca2d623 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3852024-09-23T23:15:34.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 92a3a060-48ed-4449-a19c-a1461ca2d623 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3862024-09-23T23:15:35.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eb9e6c65-0b5a-4775-b803-b4e5c4f414c5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3872024-09-23T23:15:35.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eb9e6c65-0b5a-4775-b803-b4e5c4f414c5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3882024-09-23T23:15:35.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eb9e6c65-0b5a-4775-b803-b4e5c4f414c5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3892024-09-23T23:15:36.067ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1322 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 09bbc60a-489e-4fd6-8ac5-427041318030 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
3902024-09-23T23:15:36.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ea1692c8-37b1-4dbb-9ccd-c5ea74c76b10 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3912024-09-23T23:15:36.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ea1692c8-37b1-4dbb-9ccd-c5ea74c76b10 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3922024-09-23T23:15:36.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ea1692c8-37b1-4dbb-9ccd-c5ea74c76b10 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3932024-09-23T23:15:37.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0a2a9985-d530-479a-8bd0-1d5d45c23db4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3942024-09-23T23:15:37.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0a2a9985-d530-479a-8bd0-1d5d45c23db4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3952024-09-23T23:15:37.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0a2a9985-d530-479a-8bd0-1d5d45c23db4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
3962024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
3972024-09-23T23:15:37.800ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-23 23:05:37.800804999 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3982024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3992024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
4002024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
4012024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4022024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4032024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
4042024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
4052024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4062024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4072024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
4082024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4092024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
4102024-09-23T23:15:37.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
4112024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
4122024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
4132024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4142024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4152024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
4162024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
4172024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4182024-09-23T23:15:37.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82
4192024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
4202024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.56\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82"}
4212024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4222024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4232024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4242024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4252024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4262024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4272024-09-23T23:15:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4282024-09-23T23:15:37.801ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("954a3d10-a2dd-433b-9252-ede695863bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 688043641 } })
4292024-09-23T23:15:37.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65799211-2178-4ef6-a14b-629ea048347e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2729181-3180-4ecf-bd42-a48f1144b71d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 688395505 } })
4302024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
4312024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4322024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4332024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4342024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4352024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4362024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4372024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4382024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4392024-09-23T23:15:37.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4402024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4412024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
4422024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
4432024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4442024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4452024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
4462024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
4472024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4482024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4492024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
4502024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4512024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
4522024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4532024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4542024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
4552024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4562024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
4572024-09-23T23:15:37.803ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4582024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
4592024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4602024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4612024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
4622024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4632024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4642024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
4652024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4662024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
4672024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4682024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
4692024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
4702024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4712024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
4722024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4732024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4742024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4752024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4762024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4772024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4782024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4792024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4802024-09-23T23:15:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4812024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4822024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4832024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4842024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4852024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4862024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4872024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4882024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4892024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4902024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4912024-09-23T23:15:37.804ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-23 23:05:37.800804999 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4922024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4932024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.985876ms iteration = 4 status = {"expiration":"2024-09-23T23:05:37.800804999Z","pruned":[]}
4942024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
4952024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
4962024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4972024-09-23T23:15:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4982024-09-23T23:15:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4992024-09-23T23:15:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5002024-09-23T23:15:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5012024-09-23T23:15:37.805ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5022024-09-23T23:15:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.291969ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5032024-09-23T23:15:37.805ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
5042024-09-23T23:15:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.338379ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
5052024-09-23T23:15:37.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 692686054 } })
5062024-09-23T23:15:37.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5072024-09-23T23:15:37.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5082024-09-23T23:15:37.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
5092024-09-23T23:15:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5102024-09-23T23:15:37.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5112024-09-23T23:15:37.808ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5122024-09-23T23:15:37.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 695973882 } })
5132024-09-23T23:15:37.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
5142024-09-23T23:15:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5152024-09-23T23:15:37.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5162024-09-23T23:15:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5172024-09-23T23:15:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5182024-09-23T23:15:37.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5192024-09-23T23:15:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5202024-09-23T23:15:37.812ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212024-09-23T23:15:37.813ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5222024-09-23T23:15:37.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5232024-09-23T23:15:37.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5242024-09-23T23:15:37.814ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5252024-09-23T23:15:37.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5262024-09-23T23:15:37.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5272024-09-23T23:15:37.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5282024-09-23T23:15:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5292024-09-23T23:15:37.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5302024-09-23T23:15:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5312024-09-23T23:15:37.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5322024-09-23T23:15:37.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5332024-09-23T23:15:37.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5342024-09-23T23:15:37.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5352024-09-23T23:15:37.823ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.252314ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
5362024-09-23T23:15:37.824ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5372024-09-23T23:15:37.824ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5382024-09-23T23:15:37.824ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.106303ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5392024-09-23T23:15:37.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5402024-09-23T23:15:37.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5412024-09-23T23:15:37.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5422024-09-23T23:15:37.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432024-09-23T23:15:37.828ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5442024-09-23T23:15:37.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5452024-09-23T23:15:37.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5462024-09-23T23:15:37.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5472024-09-23T23:15:37.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5482024-09-23T23:15:37.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5492024-09-23T23:15:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5502024-09-23T23:15:37.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5512024-09-23T23:15:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5522024-09-23T23:15:37.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.798808ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5532024-09-23T23:15:37.840ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1137, tv_nsec: 727025930 } })
5542024-09-23T23:15:37.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5552024-09-23T23:15:37.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5562024-09-23T23:15:37.841ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
5572024-09-23T23:15:37.851ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5582024-09-23T23:15:37.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5592024-09-23T23:15:37.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5602024-09-23T23:15:37.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5612024-09-23T23:15:37.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5622024-09-23T23:15:37.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5632024-09-23T23:15:37.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5642024-09-23T23:15:37.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.434535ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
5652024-09-23T23:15:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5662024-09-23T23:15:37.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5672024-09-23T23:15:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5682024-09-23T23:15:37.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692024-09-23T23:15:37.864ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5702024-09-23T23:15:37.864ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5712024-09-23T23:15:37.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5722024-09-23T23:15:37.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5732024-09-23T23:15:37.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5742024-09-23T23:15:37.865ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5752024-09-23T23:15:37.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5762024-09-23T23:15:37.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772024-09-23T23:15:37.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5782024-09-23T23:15:37.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5792024-09-23T23:15:37.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5802024-09-23T23:15:37.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5812024-09-23T23:15:37.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5822024-09-23T23:15:37.869ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5832024-09-23T23:15:37.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5842024-09-23T23:15:37.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5852024-09-23T23:15:37.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5862024-09-23T23:15:37.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5872024-09-23T23:15:37.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5882024-09-23T23:15:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5892024-09-23T23:15:37.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5902024-09-23T23:15:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5912024-09-23T23:15:37.873ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5922024-09-23T23:15:37.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5932024-09-23T23:15:37.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5942024-09-23T23:15:37.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5952024-09-23T23:15:37.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5962024-09-23T23:15:37.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5972024-09-23T23:15:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5982024-09-23T23:15:37.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5992024-09-23T23:15:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6002024-09-23T23:15:37.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6012024-09-23T23:15:37.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 71.814458ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6022024-09-23T23:15:37.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6032024-09-23T23:15:37.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6042024-09-23T23:15:37.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6052024-09-23T23:15:37.878ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062024-09-23T23:15:37.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6072024-09-23T23:15:37.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6082024-09-23T23:15:37.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6092024-09-23T23:15:37.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6102024-09-23T23:15:37.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.010476ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
6112024-09-23T23:15:37.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6122024-09-23T23:15:37.881ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6132024-09-23T23:15:37.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6142024-09-23T23:15:37.886ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6152024-09-23T23:15:37.886ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.679963ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6162024-09-23T23:15:37.899ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 97.969899ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6172024-09-23T23:15:37.900ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
6182024-09-23T23:15:37.900ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 97.198101ms iteration = 4 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
6192024-09-23T23:15:37.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6202024-09-23T23:15:37.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
6212024-09-23T23:15:37.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6222024-09-23T23:15:37.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6232024-09-23T23:15:37.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.124323ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6242024-09-23T23:15:37.914ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6252024-09-23T23:15:37.914ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6262024-09-23T23:15:37.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6272024-09-23T23:15:37.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6282024-09-23T23:15:37.955ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6292024-09-23T23:15:37.978ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6302024-09-23T23:15:37.978ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6312024-09-23T23:15:37.978ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6322024-09-23T23:15:37.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6332024-09-23T23:15:37.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6342024-09-23T23:15:37.985ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
6352024-09-23T23:15:37.985ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6362024-09-23T23:15:37.985ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3fb99d9c-199f-482d-965b-b0dc6fe70a7a", "content-length": "26", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
6372024-09-23T23:15:37.985ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6382024-09-23T23:15:37.988ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6392024-09-23T23:15:38.010ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6402024-09-23T23:15:38.010ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6412024-09-23T23:15:38.010ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6422024-09-23T23:15:38.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6432024-09-23T23:15:38.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6442024-09-23T23:15:38.019ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
6452024-09-23T23:15:38.019ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6462024-09-23T23:15:38.020ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a7846ea3-46f8-484c-aca6-1a19413a285f", "content-length": "26", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
6472024-09-23T23:15:38.020ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6482024-09-23T23:15:38.022ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
6492024-09-23T23:15:38.045ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
6502024-09-23T23:15:38.045ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::3)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b5c4891d-68b5-4102-86cc-9a397a4e3ca0", "content-length": "64", "date": "Mon, 23 Sep 2024 23:15:38 GMT"} })
6512024-09-23T23:15:38.045ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6522024-09-23T23:15:38.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6532024-09-23T23:15:38.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542024-09-23T23:15:38.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6552024-09-23T23:15:38.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6562024-09-23T23:15:38.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6572024-09-23T23:15:38.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6582024-09-23T23:15:38.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6592024-09-23T23:15:38.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6602024-09-23T23:15:38.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6612024-09-23T23:15:38.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6622024-09-23T23:15:38.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6632024-09-23T23:15:38.071ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
6642024-09-23T23:15:38.071ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 269.86798ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
6652024-09-23T23:15:38.075ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
6662024-09-23T23:15:38.088ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 285.367018ms iteration = 10 status = {"physical_disks_added":0}
6672024-09-23T23:15:38.089ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
6682024-09-23T23:15:38.090ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6692024-09-23T23:15:38.090ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d560468-a359-46a3-a0e2-887e28a5cfb5", "content-length": "26", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
6702024-09-23T23:15:38.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6712024-09-23T23:15:38.090ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6722024-09-23T23:15:38.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6732024-09-23T23:15:38.093ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6742024-09-23T23:15:38.100ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6752024-09-23T23:15:38.100ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6762024-09-23T23:15:38.100ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 297.071414ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6772024-09-23T23:15:38.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 299.230149ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6782024-09-23T23:15:38.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6792024-09-23T23:15:38.104ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
6802024-09-23T23:15:38.104ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
6812024-09-23T23:15:38.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6822024-09-23T23:15:38.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6832024-09-23T23:15:38.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6842024-09-23T23:15:38.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6852024-09-23T23:15:38.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6862024-09-23T23:15:38.107ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6872024-09-23T23:15:38.108ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6882024-09-23T23:15:38.108ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6892024-09-23T23:15:38.108ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 305.047615ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6902024-09-23T23:15:38.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6912024-09-23T23:15:38.109ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6922024-09-23T23:15:38.109ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6932024-09-23T23:15:38.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6942024-09-23T23:15:38.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6952024-09-23T23:15:38.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6962024-09-23T23:15:38.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6972024-09-23T23:15:38.111ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6982024-09-23T23:15:38.111ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 0 version = 2
6992024-09-23T23:15:38.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7002024-09-23T23:15:38.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7012024-09-23T23:15:38.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-09-23T23:15:38.114ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 312.072856ms iteration = 3 status = {"nsuccess":5}
7032024-09-23T23:15:38.114ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
7042024-09-23T23:15:38.114ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7052024-09-23T23:15:38.114ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-23 23:12:39.428682 UTC dns_group = internal generation = 1
7062024-09-23T23:15:38.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 313.622245ms iteration = 5 status = {"generation":1}
7072024-09-23T23:15:38.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7082024-09-23T23:15:38.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7092024-09-23T23:15:38.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7102024-09-23T23:15:38.118ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7112024-09-23T23:15:38.119ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6b534a3a-4a58-41ef-8895-10135e9db91f", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7122024-09-23T23:15:38.119ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7132024-09-23T23:15:38.122ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "922b65ec-b95f-4799-97f2-f85a4adfac9d", "date": "Mon, 23 Sep 2024 23:15:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7142024-09-23T23:15:38.122ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7152024-09-23T23:15:38.123ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7162024-09-23T23:15:38.125ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7172024-09-23T23:15:38.125ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 324.277537ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7182024-09-23T23:15:38.125ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7192024-09-23T23:15:38.125ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7202024-09-23T23:15:38.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7212024-09-23T23:15:38.134ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7222024-09-23T23:15:38.134ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9d2d335c-bee5-42c2-ae79-0eeb2ba773ab", "content-length": "1", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
7232024-09-23T23:15:38.137ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7242024-09-23T23:15:38.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7252024-09-23T23:15:38.157ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-23T23:12:36.221760Z, time_modified: 2024-09-23T23:12:36.221760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }) }
7262024-09-23T23:15:38.157ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 357.025304ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]}},"default_endpoint":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7272024-09-23T23:15:38.213ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 1 version = 2
7282024-09-23T23:15:38.213ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7292024-09-23T23:15:38.213ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-23 23:12:40.294485 UTC dns_group = external generation = 2
7302024-09-23T23:15:38.213ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 413.0021ms iteration = 5 status = {"generation":2}
7312024-09-23T23:15:38.225ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 424.530102ms iteration = 7 status = {}
7322024-09-23T23:15:38.228ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7332024-09-23T23:15:38.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 72aa68e9-2c7b-40e5-afb5-aa5033c67349 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
7342024-09-23T23:15:38.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 72aa68e9-2c7b-40e5-afb5-aa5033c67349 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
7352024-09-23T23:15:38.336ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7362024-09-23T23:15:38.336ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "84b7cb2a-8eff-4f57-9ab7-30ba83519ab5", "date": "Mon, 23 Sep 2024 23:15:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7372024-09-23T23:15:38.336ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7382024-09-23T23:15:38.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7a27050d-12f2-4412-834c-d1fbe67fb5ce", "date": "Mon, 23 Sep 2024 23:15:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7392024-09-23T23:15:38.337ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7402024-09-23T23:15:38.338ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2e9b2ad9-29f6-4bb1-9228-d35bb2615f89", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7412024-09-23T23:15:38.338ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7422024-09-23T23:15:38.340ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7432024-09-23T23:15:38.340ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 539.73603ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7442024-09-23T23:15:38.358ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7452024-09-23T23:15:38.358ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "040610bc-99ba-4a4c-8d49-a13827a20e43", "content-length": "691", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
7462024-09-23T23:15:38.358ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7472024-09-23T23:15:38.358ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7482024-09-23T23:15:38.358ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7492024-09-23T23:15:38.360ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 556.870878ms iteration = 7 status = {}
7502024-09-23T23:15:38.362ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7512024-09-23T23:15:38.362ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f50218b8-b153-41c8-9a4c-197a02e925a6", "content-length": "372", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
7522024-09-23T23:15:38.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7532024-09-23T23:15:38.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7542024-09-23T23:15:38.364ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 563.213251ms iteration = 7 status = null
7552024-09-23T23:15:38.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7562024-09-23T23:15:38.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 71077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 72aa68e9-2c7b-40e5-afb5-aa5033c67349 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
7572024-09-23T23:15:38.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7582024-09-23T23:15:38.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7592024-09-23T23:15:38.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7602024-09-23T23:15:38.373ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7612024-09-23T23:15:38.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7622024-09-23T23:15:38.373ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c850c4de-e5f3-4ed8-8604-9be693163732", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
7632024-09-23T23:15:38.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7642024-09-23T23:15:38.374ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 571.138022ms iteration = 8 status = {}
7652024-09-23T23:15:38.375ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
7662024-09-23T23:15:38.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7672024-09-23T23:15:38.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7682024-09-23T23:15:38.384ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7692024-09-23T23:15:38.386ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3100e15b-a416-47e0-a3fa-54c7cad6b726", "content-length": "121", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
7702024-09-23T23:15:38.386ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
7712024-09-23T23:15:38.386ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
7722024-09-23T23:15:38.386ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7732024-09-23T23:15:38.386ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7742024-09-23T23:15:38.386ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
7752024-09-23T23:15:38.386ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
7762024-09-23T23:15:38.386ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
7772024-09-23T23:15:38.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7782024-09-23T23:15:38.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7792024-09-23T23:15:38.388ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7802024-09-23T23:15:38.388ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b972da9a-a02f-4d96-b3c3-33e099449c43", "content-length": "2", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
7812024-09-23T23:15:38.388ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7822024-09-23T23:15:38.388ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3860fbd8-cd28-4227-86a6-6bf15637001c", "content-length": "52", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
7832024-09-23T23:15:38.388ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
7842024-09-23T23:15:38.388ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7852024-09-23T23:15:38.505ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d02a0a87-bdd5-45dd-bc93-c38b5080d05e", "date": "Mon, 23 Sep 2024 23:15:37 GMT"} })
7862024-09-23T23:15:38.505ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
7872024-09-23T23:15:38.505ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7882024-09-23T23:15:38.505ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d0b10c5-c7e9-4e7a-bad4-c6555d7f305a", "content-length": "667", "date": "Mon, 23 Sep 2024 23:15:38 GMT"} })
7892024-09-23T23:15:38.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7902024-09-23T23:15:38.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7912024-09-23T23:15:38.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7922024-09-23T23:15:38.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7932024-09-23T23:15:38.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7942024-09-23T23:15:38.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7952024-09-23T23:15:38.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7962024-09-23T23:15:38.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7972024-09-23T23:15:38.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7982024-09-23T23:15:38.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
7992024-09-23T23:15:38.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8002024-09-23T23:15:38.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8012024-09-23T23:15:38.522ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 719.037547ms iteration = 7 status = 0
8022024-09-23T23:15:38.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8032024-09-23T23:15:38.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8042024-09-23T23:15:38.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8052024-09-23T23:15:38.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8062024-09-23T23:15:38.635ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 831.686346ms iteration = 7 status = {}
8072024-09-23T23:15:38.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4ded17ed-3f7d-4249-9048-145bea1f7fde roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8082024-09-23T23:15:38.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4ded17ed-3f7d-4249-9048-145bea1f7fde resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8092024-09-23T23:15:38.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4ded17ed-3f7d-4249-9048-145bea1f7fde response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8102024-09-23T23:15:39.398ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43612
8112024-09-23T23:15:39.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43612 req_id = b51dcd28-6c71-45f6-85d7-f27f9d88aebd roles = RoleSet { roles: {} } uri = /metrics/producers
8122024-09-23T23:15:39.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43612 req_id = b51dcd28-6c71-45f6-85d7-f27f9d88aebd resource = Database result = Ok(()) uri = /metrics/producers
8132024-09-23T23:15:39.431ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
8142024-09-23T23:15:39.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43612 req_id = b51dcd28-6c71-45f6-85d7-f27f9d88aebd roles = RoleSet { roles: {} } uri = /metrics/producers
8152024-09-23T23:15:39.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43612 req_id = b51dcd28-6c71-45f6-85d7-f27f9d88aebd resource = Database result = Ok(()) uri = /metrics/producers
8162024-09-23T23:15:39.464ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
8172024-09-23T23:15:39.465ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "624cce3a-0f4b-4f18-8cdb-9e67212a5b21", "date": "Mon, 23 Sep 2024 23:15:39 GMT"} })
8182024-09-23T23:15:39.465ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = 09b2e92f-0f56-43ff-8e2a-6b0e41405076
8192024-09-23T23:15:39.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66784 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43612 req_id = b51dcd28-6c71-45f6-85d7-f27f9d88aebd response_code = 201 uri = /metrics/producers
8202024-09-23T23:15:39.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e9235ef-c312-4f19-9c7d-15bd31511dd3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8212024-09-23T23:15:39.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e9235ef-c312-4f19-9c7d-15bd31511dd3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8222024-09-23T23:15:39.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e9235ef-c312-4f19-9c7d-15bd31511dd3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8232024-09-23T23:15:40.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 64d254ff-8cca-488e-89cd-788acf500ffb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8242024-09-23T23:15:40.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 64d254ff-8cca-488e-89cd-788acf500ffb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8252024-09-23T23:15:40.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 64d254ff-8cca-488e-89cd-788acf500ffb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8262024-09-23T23:15:41.362ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:40898
8272024-09-23T23:15:41.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40898 req_id = 90f8dbcd-6c23-427a-9c57-8ac0ae9fc5e3 roles = RoleSet { roles: {} } uri = /metrics/producers
8282024-09-23T23:15:41.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40898 req_id = 90f8dbcd-6c23-427a-9c57-8ac0ae9fc5e3 resource = Database result = Ok(()) uri = /metrics/producers
8292024-09-23T23:15:41.394ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
8302024-09-23T23:15:41.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40898 req_id = 90f8dbcd-6c23-427a-9c57-8ac0ae9fc5e3 roles = RoleSet { roles: {} } uri = /metrics/producers
8312024-09-23T23:15:41.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40898 req_id = 90f8dbcd-6c23-427a-9c57-8ac0ae9fc5e3 resource = Database result = Ok(()) uri = /metrics/producers
8322024-09-23T23:15:41.430ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
8332024-09-23T23:15:41.430ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f3bca1c8-a31b-41af-8bf6-ac1e650ab61b", "date": "Mon, 23 Sep 2024 23:15:41 GMT"} })
8342024-09-23T23:15:41.430ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
8352024-09-23T23:15:41.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69215 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:40898 req_id = 90f8dbcd-6c23-427a-9c57-8ac0ae9fc5e3 response_code = 201 uri = /metrics/producers
8362024-09-23T23:15:41.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 23c1783f-8565-4976-96d3-42aa76c4b9fa roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8372024-09-23T23:15:41.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 23c1783f-8565-4976-96d3-42aa76c4b9fa resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8382024-09-23T23:15:41.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 23c1783f-8565-4976-96d3-42aa76c4b9fa response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8392024-09-23T23:15:42.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3514d77d-ffba-447f-996a-e852ae40abcb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8402024-09-23T23:15:42.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3514d77d-ffba-447f-996a-e852ae40abcb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8412024-09-23T23:15:42.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3514d77d-ffba-447f-996a-e852ae40abcb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8422024-09-23T23:15:43.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f7de9943-8d71-4802-870e-8b3d62a67047 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8432024-09-23T23:15:43.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f7de9943-8d71-4802-870e-8b3d62a67047 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8442024-09-23T23:15:43.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f7de9943-8d71-4802-870e-8b3d62a67047 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8452024-09-23T23:15:44.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d0c3213d-4e9a-427f-8f42-9324a990ea7d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8462024-09-23T23:15:44.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d0c3213d-4e9a-427f-8f42-9324a990ea7d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8472024-09-23T23:15:44.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d0c3213d-4e9a-427f-8f42-9324a990ea7d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8482024-09-23T23:15:45.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 76f91c28-904f-46fc-ae1e-9b03f0d2dc3f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8492024-09-23T23:15:45.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 76f91c28-904f-46fc-ae1e-9b03f0d2dc3f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8502024-09-23T23:15:45.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2616 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 76f91c28-904f-46fc-ae1e-9b03f0d2dc3f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8512024-09-23T23:15:46.068ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1331 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 76999be0-8301-4903-ac25-2114ae35fc49 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
8522024-09-23T23:15:46.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a355a4be-b529-4433-8a23-5e06a056ae5f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8532024-09-23T23:15:46.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a355a4be-b529-4433-8a23-5e06a056ae5f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8542024-09-23T23:15:46.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a355a4be-b529-4433-8a23-5e06a056ae5f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8552024-09-23T23:15:47.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
8562024-09-23T23:15:47.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8572024-09-23T23:15:47.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8582024-09-23T23:15:47.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
8592024-09-23T23:15:47.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8602024-09-23T23:15:47.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8612024-09-23T23:15:47.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8622024-09-23T23:15:47.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8632024-09-23T23:15:47.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8642024-09-23T23:15:47.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8652024-09-23T23:15:47.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8662024-09-23T23:15:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8672024-09-23T23:15:47.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8682024-09-23T23:15:47.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
8692024-09-23T23:15:47.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8702024-09-23T23:15:47.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8712024-09-23T23:15:47.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
8722024-09-23T23:15:47.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.300302ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
8732024-09-23T23:15:47.829ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8742024-09-23T23:15:47.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8752024-09-23T23:15:47.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.143533ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8762024-09-23T23:15:47.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4da49a4c-0322-4f88-89d2-c331f826b20a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8772024-09-23T23:15:47.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4da49a4c-0322-4f88-89d2-c331f826b20a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8782024-09-23T23:15:47.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4da49a4c-0322-4f88-89d2-c331f826b20a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8792024-09-23T23:15:48.871ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62483
8802024-09-23T23:15:48.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62483 req_id = 4e3a3b69-83f3-4d85-90e0-d2ad2f97e261 roles = RoleSet { roles: {} } uri = /metrics/producers
8812024-09-23T23:15:48.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62483 req_id = 4e3a3b69-83f3-4d85-90e0-d2ad2f97e261 resource = Database result = Ok(()) uri = /metrics/producers
8822024-09-23T23:15:48.903ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
8832024-09-23T23:15:48.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62483 req_id = 4e3a3b69-83f3-4d85-90e0-d2ad2f97e261 roles = RoleSet { roles: {} } uri = /metrics/producers
8842024-09-23T23:15:48.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62483 req_id = 4e3a3b69-83f3-4d85-90e0-d2ad2f97e261 resource = Database result = Ok(()) uri = /metrics/producers
8852024-09-23T23:15:48.909ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
8862024-09-23T23:15:48.909ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2b8653f9-14d2-4c11-9112-d552b3207395", "date": "Mon, 23 Sep 2024 23:15:48 GMT"} })
8872024-09-23T23:15:48.909ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = fd52d736-9d37-4f7f-81ce-c956fa9f23e3
8882024-09-23T23:15:48.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38914 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62483 req_id = 4e3a3b69-83f3-4d85-90e0-d2ad2f97e261 response_code = 201 uri = /metrics/producers
8892024-09-23T23:15:48.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f82fab4c-bbe9-484f-afbf-1a5557a830ad roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8902024-09-23T23:15:48.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f82fab4c-bbe9-484f-afbf-1a5557a830ad resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8912024-09-23T23:15:48.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f82fab4c-bbe9-484f-afbf-1a5557a830ad response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8922024-09-23T23:15:50.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d7a7f48e-bc26-4d60-b8a3-a19ec173f3ee roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8932024-09-23T23:15:50.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d7a7f48e-bc26-4d60-b8a3-a19ec173f3ee resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8942024-09-23T23:15:50.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d7a7f48e-bc26-4d60-b8a3-a19ec173f3ee response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8952024-09-23T23:15:51.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bb4e6a5f-89c8-4d79-91a6-ba1a0bfbd99a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8962024-09-23T23:15:51.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bb4e6a5f-89c8-4d79-91a6-ba1a0bfbd99a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8972024-09-23T23:15:51.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bb4e6a5f-89c8-4d79-91a6-ba1a0bfbd99a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8982024-09-23T23:15:52.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8139bb43-e272-4891-82ef-0eb30e3ce5bd roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
8992024-09-23T23:15:52.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8139bb43-e272-4891-82ef-0eb30e3ce5bd resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9002024-09-23T23:15:52.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8139bb43-e272-4891-82ef-0eb30e3ce5bd response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9012024-09-23T23:15:53.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bf454922-b202-4e36-98d5-65a39af954f9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9022024-09-23T23:15:53.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bf454922-b202-4e36-98d5-65a39af954f9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9032024-09-23T23:15:53.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bf454922-b202-4e36-98d5-65a39af954f9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9042024-09-23T23:15:54.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cbc8ab3d-e9be-42d7-8692-954f03afe57f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9052024-09-23T23:15:54.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cbc8ab3d-e9be-42d7-8692-954f03afe57f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9062024-09-23T23:15:54.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cbc8ab3d-e9be-42d7-8692-954f03afe57f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9072024-09-23T23:15:55.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 22ff7534-c93e-49f3-a34b-084a45bd3b5a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9082024-09-23T23:15:55.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 22ff7534-c93e-49f3-a34b-084a45bd3b5a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9092024-09-23T23:15:55.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 22ff7534-c93e-49f3-a34b-084a45bd3b5a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9102024-09-23T23:15:56.068ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1349 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = e0dafb1a-38f2-4963-8016-508e54019209 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
9112024-09-23T23:15:56.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4353ca49-e1a3-4ae0-8bc4-1f044c3fb38a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9122024-09-23T23:15:56.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4353ca49-e1a3-4ae0-8bc4-1f044c3fb38a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9132024-09-23T23:15:56.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4353ca49-e1a3-4ae0-8bc4-1f044c3fb38a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9142024-09-23T23:15:56.725ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44864
9152024-09-23T23:15:56.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44864 req_id = 4cf40ea2-ff20-4e5b-94d7-33c8486573bc roles = RoleSet { roles: {} } uri = /metrics/producers
9162024-09-23T23:15:56.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44864 req_id = 4cf40ea2-ff20-4e5b-94d7-33c8486573bc resource = Database result = Ok(()) uri = /metrics/producers
9172024-09-23T23:15:56.757ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
9182024-09-23T23:15:56.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44864 req_id = 4cf40ea2-ff20-4e5b-94d7-33c8486573bc roles = RoleSet { roles: {} } uri = /metrics/producers
9192024-09-23T23:15:56.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44864 req_id = 4cf40ea2-ff20-4e5b-94d7-33c8486573bc resource = Database result = Ok(()) uri = /metrics/producers
9202024-09-23T23:15:56.765ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
9212024-09-23T23:15:56.766ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b7522453-86da-4b03-9a2f-e0f3cb7c20eb", "date": "Mon, 23 Sep 2024 23:15:56 GMT"} })
9222024-09-23T23:15:56.766ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = c1c0a7ac-2dfc-4b9c-8213-1795864579b6
9232024-09-23T23:15:56.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41056 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44864 req_id = 4cf40ea2-ff20-4e5b-94d7-33c8486573bc response_code = 201 uri = /metrics/producers
9242024-09-23T23:15:57.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b7a570d0-0b8e-4b78-a14d-3edfbfe5cbde roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9252024-09-23T23:15:57.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b7a570d0-0b8e-4b78-a14d-3edfbfe5cbde resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9262024-09-23T23:15:57.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b7a570d0-0b8e-4b78-a14d-3edfbfe5cbde response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9272024-09-23T23:15:57.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
9282024-09-23T23:15:57.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9292024-09-23T23:15:57.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9302024-09-23T23:15:57.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
9312024-09-23T23:15:57.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9322024-09-23T23:15:57.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9332024-09-23T23:15:57.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9342024-09-23T23:15:57.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9352024-09-23T23:15:57.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9362024-09-23T23:15:57.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9372024-09-23T23:15:57.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9382024-09-23T23:15:57.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9392024-09-23T23:15:57.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9402024-09-23T23:15:57.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9412024-09-23T23:15:57.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9422024-09-23T23:15:57.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
9432024-09-23T23:15:57.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9442024-09-23T23:15:57.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9452024-09-23T23:15:57.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
9462024-09-23T23:15:57.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.770587ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
9472024-09-23T23:15:57.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.832022ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9482024-09-23T23:15:58.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c4e6ad44-b5b1-4e58-b1a1-1b33b699c648 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9492024-09-23T23:15:58.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c4e6ad44-b5b1-4e58-b1a1-1b33b699c648 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9502024-09-23T23:15:58.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c4e6ad44-b5b1-4e58-b1a1-1b33b699c648 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9512024-09-23T23:15:59.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 39c4802c-3f94-4071-ace7-2b4414215d69 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9522024-09-23T23:15:59.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 39c4802c-3f94-4071-ace7-2b4414215d69 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9532024-09-23T23:15:59.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1999 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 39c4802c-3f94-4071-ace7-2b4414215d69 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9542024-09-23T23:16:00.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 49e5bad7-7fed-4dce-a5b2-bbb47c635a7f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9552024-09-23T23:16:00.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 49e5bad7-7fed-4dce-a5b2-bbb47c635a7f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9562024-09-23T23:16:00.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 49e5bad7-7fed-4dce-a5b2-bbb47c635a7f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9572024-09-23T23:16:01.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4587904a-5288-4e49-989e-9c5df342c391 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9582024-09-23T23:16:01.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4587904a-5288-4e49-989e-9c5df342c391 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9592024-09-23T23:16:01.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4587904a-5288-4e49-989e-9c5df342c391 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9602024-09-23T23:16:02.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ef5ac362-6e02-47dd-9ab2-39ad7d259d93 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9612024-09-23T23:16:02.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ef5ac362-6e02-47dd-9ab2-39ad7d259d93 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9622024-09-23T23:16:02.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ef5ac362-6e02-47dd-9ab2-39ad7d259d93 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9632024-09-23T23:16:03.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41663e2f-a144-465e-af06-1152f43dc23c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9642024-09-23T23:16:03.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41663e2f-a144-465e-af06-1152f43dc23c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9652024-09-23T23:16:03.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41663e2f-a144-465e-af06-1152f43dc23c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9662024-09-23T23:16:04.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ccbe01ae-8e6e-4021-bfe0-4bf792b28674 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9672024-09-23T23:16:04.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ccbe01ae-8e6e-4021-bfe0-4bf792b28674 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9682024-09-23T23:16:04.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ccbe01ae-8e6e-4021-bfe0-4bf792b28674 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9692024-09-23T23:16:05.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6640498b-c7f6-4f96-9ebc-e8014b03925e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9702024-09-23T23:16:05.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6640498b-c7f6-4f96-9ebc-e8014b03925e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9712024-09-23T23:16:05.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6640498b-c7f6-4f96-9ebc-e8014b03925e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9722024-09-23T23:16:06.068ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1337 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = f6059a9a-8322-4c45-b520-204ec00e568d response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
9732024-09-23T23:16:06.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5fac537-bd5b-4ba7-bd67-9ad9b28e2687 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9742024-09-23T23:16:06.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5fac537-bd5b-4ba7-bd67-9ad9b28e2687 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9752024-09-23T23:16:06.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5fac537-bd5b-4ba7-bd67-9ad9b28e2687 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9762024-09-23T23:16:07.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 048d2c26-b7c8-49c2-9db0-f71e551fc8ad roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9772024-09-23T23:16:07.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 048d2c26-b7c8-49c2-9db0-f71e551fc8ad resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9782024-09-23T23:16:07.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 048d2c26-b7c8-49c2-9db0-f71e551fc8ad response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
9792024-09-23T23:16:07.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
9802024-09-23T23:16:07.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9812024-09-23T23:16:07.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
9822024-09-23T23:16:07.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9832024-09-23T23:16:07.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9842024-09-23T23:16:07.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9852024-09-23T23:16:07.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
9862024-09-23T23:16:07.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
9872024-09-23T23:16:07.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9882024-09-23T23:16:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9892024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
9902024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
9912024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9922024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9932024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
9942024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
9952024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
9962024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9972024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9982024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9992024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10002024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
10012024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10022024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
10032024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
10042024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10052024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10062024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
10072024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
10082024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10092024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
10102024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10112024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10122024-09-23T23:16:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10132024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10142024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10152024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10162024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10172024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10182024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10192024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10202024-09-23T23:16:07.804ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1167, tv_nsec: 690394078 } })
10212024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10222024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10232024-09-23T23:16:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10242024-09-23T23:16:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
10252024-09-23T23:16:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10262024-09-23T23:16:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
10272024-09-23T23:16:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10282024-09-23T23:16:07.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10292024-09-23T23:16:07.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1167, tv_nsec: 691664262 } })
10302024-09-23T23:16:07.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
10312024-09-23T23:16:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10322024-09-23T23:16:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10332024-09-23T23:16:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10342024-09-23T23:16:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10352024-09-23T23:16:07.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10362024-09-23T23:16:07.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.499972ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10372024-09-23T23:16:07.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
10382024-09-23T23:16:07.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10392024-09-23T23:16:07.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10402024-09-23T23:16:07.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10412024-09-23T23:16:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10422024-09-23T23:16:07.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10432024-09-23T23:16:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10442024-09-23T23:16:07.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10452024-09-23T23:16:07.811ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10462024-09-23T23:16:07.811ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10472024-09-23T23:16:07.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10482024-09-23T23:16:07.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10492024-09-23T23:16:07.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10502024-09-23T23:16:07.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10512024-09-23T23:16:07.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10522024-09-23T23:16:07.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10532024-09-23T23:16:07.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10542024-09-23T23:16:07.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10552024-09-23T23:16:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10562024-09-23T23:16:07.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10572024-09-23T23:16:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10582024-09-23T23:16:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10592024-09-23T23:16:07.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10602024-09-23T23:16:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10612024-09-23T23:16:07.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10622024-09-23T23:16:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10632024-09-23T23:16:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10642024-09-23T23:16:07.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.973532ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10652024-09-23T23:16:07.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10662024-09-23T23:16:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10672024-09-23T23:16:07.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10682024-09-23T23:16:07.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10692024-09-23T23:16:07.820ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10702024-09-23T23:16:07.820ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10712024-09-23T23:16:07.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10722024-09-23T23:16:07.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10732024-09-23T23:16:07.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1167, tv_nsec: 707419194 } })
10742024-09-23T23:16:07.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
10752024-09-23T23:16:07.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10762024-09-23T23:16:07.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10772024-09-23T23:16:07.824ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10782024-09-23T23:16:07.824ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.178554ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10792024-09-23T23:16:07.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.319887ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
10802024-09-23T23:16:07.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10812024-09-23T23:16:07.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10822024-09-23T23:16:07.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10832024-09-23T23:16:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10842024-09-23T23:16:07.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10852024-09-23T23:16:07.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10862024-09-23T23:16:07.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.828286ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
10872024-09-23T23:16:07.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10882024-09-23T23:16:07.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10892024-09-23T23:16:07.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10902024-09-23T23:16:07.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10912024-09-23T23:16:07.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.835203ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10922024-09-23T23:16:07.859ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10932024-09-23T23:16:07.859ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10942024-09-23T23:16:07.859ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 55.582851ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10952024-09-23T23:16:07.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-09-23T23:16:07.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10972024-09-23T23:16:07.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10982024-09-23T23:16:07.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10992024-09-23T23:16:07.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11002024-09-23T23:16:07.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
11012024-09-23T23:16:07.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11022024-09-23T23:16:07.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11032024-09-23T23:16:07.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11042024-09-23T23:16:07.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11052024-09-23T23:16:07.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11062024-09-23T23:16:07.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11072024-09-23T23:16:07.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
11082024-09-23T23:16:07.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11092024-09-23T23:16:07.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11102024-09-23T23:16:07.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11112024-09-23T23:16:07.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11122024-09-23T23:16:07.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11132024-09-23T23:16:07.867ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.038238ms iteration = 8 status = 0
11142024-09-23T23:16:07.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11152024-09-23T23:16:07.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11162024-09-23T23:16:07.879ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 75.393969ms iteration = 11 status = {"physical_disks_added":0}
11172024-09-23T23:16:07.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
11182024-09-23T23:16:07.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.511034ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
11192024-09-23T23:16:07.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.28297ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11202024-09-23T23:16:07.887ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11212024-09-23T23:16:07.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11222024-09-23T23:16:07.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.489284ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11232024-09-23T23:16:07.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
11242024-09-23T23:16:07.898ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11252024-09-23T23:16:07.898ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4ff3f57-8d0b-4c75-b050-5c81325b13d3", "content-length": "26", "date": "Mon, 23 Sep 2024 23:16:07 GMT"} })
11262024-09-23T23:16:07.898ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11272024-09-23T23:16:07.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11282024-09-23T23:16:07.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11292024-09-23T23:16:07.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11302024-09-23T23:16:07.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11312024-09-23T23:16:07.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11322024-09-23T23:16:07.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11332024-09-23T23:16:07.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11342024-09-23T23:16:07.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11352024-09-23T23:16:07.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11362024-09-23T23:16:08.004ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
11372024-09-23T23:16:08.004ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11382024-09-23T23:16:08.004ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7feeb71d-1c3b-4082-a546-f98a4685a28e", "content-length": "26", "date": "Mon, 23 Sep 2024 23:16:07 GMT"} })
11392024-09-23T23:16:08.004ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11402024-09-23T23:16:08.006ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11412024-09-23T23:16:08.040ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 239.423099ms iteration = 8 status = {}
11422024-09-23T23:16:08.065ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11432024-09-23T23:16:08.066ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
11442024-09-23T23:16:08.066ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11452024-09-23T23:16:08.066ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6edfadde-6bda-4432-9e00-ed8b50b03142", "content-length": "26", "date": "Mon, 23 Sep 2024 23:16:07 GMT"} })
11462024-09-23T23:16:08.066ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11472024-09-23T23:16:08.067ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11482024-09-23T23:16:08.067ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
11492024-09-23T23:16:08.121ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11502024-09-23T23:16:08.121ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "00574c85-ef47-4dc6-a325-55f63e0d3478", "content-length": "372", "date": "Mon, 23 Sep 2024 23:16:07 GMT"} })
11512024-09-23T23:16:08.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11522024-09-23T23:16:08.121ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5c2e8632-a512-45ba-876a-5d8edf3152b8", "content-length": "691", "date": "Mon, 23 Sep 2024 23:16:08 GMT"} })
11532024-09-23T23:16:08.121ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11542024-09-23T23:16:08.121ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11552024-09-23T23:16:08.121ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11562024-09-23T23:16:08.121ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c59b265-7782-4783-a9ea-39b8e095e3c5", "content-length": "1", "date": "Mon, 23 Sep 2024 23:16:08 GMT"} })
11572024-09-23T23:16:08.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11582024-09-23T23:16:08.124ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.637985ms iteration = 8 status = {}
11592024-09-23T23:16:08.124ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11602024-09-23T23:16:08.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11612024-09-23T23:16:08.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11622024-09-23T23:16:08.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11632024-09-23T23:16:08.127ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 326.499973ms iteration = 8 status = null
11642024-09-23T23:16:08.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11652024-09-23T23:16:08.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11662024-09-23T23:16:08.131ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11672024-09-23T23:16:08.131ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ce0fd010-15da-4722-98e4-cdbb74777740", "date": "Mon, 23 Sep 2024 23:16:08 GMT"} })
11682024-09-23T23:16:08.133ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 329.918482ms iteration = 9 status = {}
11692024-09-23T23:16:08.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11702024-09-23T23:16:08.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11712024-09-23T23:16:08.188ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
11722024-09-23T23:16:08.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11732024-09-23T23:16:08.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11742024-09-23T23:16:08.309ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11752024-09-23T23:16:08.309ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c6a2928-1e4e-41e3-9bf1-2e9de81339e0", "content-length": "121", "date": "Mon, 23 Sep 2024 23:16:08 GMT"} })
11762024-09-23T23:16:08.309ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
11772024-09-23T23:16:08.309ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
11782024-09-23T23:16:08.310ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11792024-09-23T23:16:08.310ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11802024-09-23T23:16:08.310ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
11812024-09-23T23:16:08.310ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
11822024-09-23T23:16:08.310ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
11832024-09-23T23:16:08.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11842024-09-23T23:16:08.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11852024-09-23T23:16:08.315ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11862024-09-23T23:16:08.316ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "501517b3-ce57-42c2-b7e9-02997f594d13", "content-length": "2", "date": "Mon, 23 Sep 2024 23:16:08 GMT"} })
11872024-09-23T23:16:08.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11882024-09-23T23:16:08.316ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "03ddb045-be4a-43b1-bb82-151fa9bd4f5e", "content-length": "52", "date": "Mon, 23 Sep 2024 23:16:08 GMT"} })
11892024-09-23T23:16:08.316ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
11902024-09-23T23:16:08.316ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11912024-09-23T23:16:08.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = ea13eb72-f994-44a1-b940-87d9ea6e33b1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
11922024-09-23T23:16:08.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = ea13eb72-f994-44a1-b940-87d9ea6e33b1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
11932024-09-23T23:16:08.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = ea13eb72-f994-44a1-b940-87d9ea6e33b1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
11942024-09-23T23:16:08.412ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3a5938c5-0865-49d5-82da-897dff7de3c2", "date": "Mon, 23 Sep 2024 23:16:08 GMT"} })
11952024-09-23T23:16:08.412ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
11962024-09-23T23:16:08.412ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11972024-09-23T23:16:08.413ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f97e468d-39aa-4011-88cd-dc394b0fff65", "content-length": "667", "date": "Mon, 23 Sep 2024 23:16:08 GMT"} })
11982024-09-23T23:16:08.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11992024-09-23T23:16:08.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12002024-09-23T23:16:08.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12012024-09-23T23:16:08.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12022024-09-23T23:16:08.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12032024-09-23T23:16:08.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12042024-09-23T23:16:08.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12052024-09-23T23:16:08.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12062024-09-23T23:16:08.430ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.517411ms iteration = 8 status = {}
12072024-09-23T23:16:08.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9485400e-88ef-45b5-83e0-75580649a577 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12082024-09-23T23:16:08.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9485400e-88ef-45b5-83e0-75580649a577 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12092024-09-23T23:16:08.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9485400e-88ef-45b5-83e0-75580649a577 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12102024-09-23T23:16:09.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2c3f3c1-6b64-4bc6-9b0a-60eb9705c8fc roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12112024-09-23T23:16:09.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2c3f3c1-6b64-4bc6-9b0a-60eb9705c8fc resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12122024-09-23T23:16:09.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2c3f3c1-6b64-4bc6-9b0a-60eb9705c8fc response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12132024-09-23T23:16:10.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 28457a17-a64b-4180-a427-61882218dc92 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12142024-09-23T23:16:10.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 28457a17-a64b-4180-a427-61882218dc92 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12152024-09-23T23:16:10.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 28457a17-a64b-4180-a427-61882218dc92 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12162024-09-23T23:16:11.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 77616561-33e2-4b43-b11a-df4bba8a4120 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12172024-09-23T23:16:11.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 77616561-33e2-4b43-b11a-df4bba8a4120 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12182024-09-23T23:16:11.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 77616561-33e2-4b43-b11a-df4bba8a4120 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12192024-09-23T23:16:12.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c3010f5f-1c8d-4c42-95d0-347af5561d7c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12202024-09-23T23:16:12.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c3010f5f-1c8d-4c42-95d0-347af5561d7c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12212024-09-23T23:16:12.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c3010f5f-1c8d-4c42-95d0-347af5561d7c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12222024-09-23T23:16:13.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 410381df-2034-449c-928b-2c2fae99c5f3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12232024-09-23T23:16:13.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 410381df-2034-449c-928b-2c2fae99c5f3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12242024-09-23T23:16:13.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 410381df-2034-449c-928b-2c2fae99c5f3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12252024-09-23T23:16:14.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 81ee971c-7e4e-4a65-950f-ca7e9d69f0a5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12262024-09-23T23:16:14.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 81ee971c-7e4e-4a65-950f-ca7e9d69f0a5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12272024-09-23T23:16:14.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 81ee971c-7e4e-4a65-950f-ca7e9d69f0a5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12282024-09-23T23:16:15.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a8544005-cf43-4423-a4fc-e08bbab6a014 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12292024-09-23T23:16:15.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a8544005-cf43-4423-a4fc-e08bbab6a014 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12302024-09-23T23:16:15.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a8544005-cf43-4423-a4fc-e08bbab6a014 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12312024-09-23T23:16:16.069ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1584 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = d09fb314-46ad-43a5-bf36-dedf3d349dcb response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
12322024-09-23T23:16:16.722ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:36556
12332024-09-23T23:16:16.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36556 req_id = e5c11412-e06d-44b0-a083-b24a040ca35c roles = RoleSet { roles: {} } uri = /metrics/producers
12342024-09-23T23:16:16.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36556 req_id = e5c11412-e06d-44b0-a083-b24a040ca35c resource = Database result = Ok(()) uri = /metrics/producers
12352024-09-23T23:16:16.755ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
12362024-09-23T23:16:16.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36556 req_id = e5c11412-e06d-44b0-a083-b24a040ca35c roles = RoleSet { roles: {} } uri = /metrics/producers
12372024-09-23T23:16:16.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36556 req_id = e5c11412-e06d-44b0-a083-b24a040ca35c resource = Database result = Ok(()) uri = /metrics/producers
12382024-09-23T23:16:16.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 19750e8f-d011-4c4f-ac33-0151d56cf1c7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12392024-09-23T23:16:16.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 19750e8f-d011-4c4f-ac33-0151d56cf1c7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12402024-09-23T23:16:16.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 19750e8f-d011-4c4f-ac33-0151d56cf1c7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12412024-09-23T23:16:16.813ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
12422024-09-23T23:16:16.814ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "95ee4afc-a724-4976-9a09-acf6aed95b7d", "date": "Mon, 23 Sep 2024 23:16:16 GMT"} })
12432024-09-23T23:16:16.814ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = ac854ddf-1dd0-4658-bc1c-106b334d06aa
12442024-09-23T23:16:16.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92969 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36556 req_id = e5c11412-e06d-44b0-a083-b24a040ca35c response_code = 201 uri = /metrics/producers
12452024-09-23T23:16:17.059ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42540
12462024-09-23T23:16:17.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42540 req_id = 20ad2f9a-878e-4ab6-844b-a2fea4155200 roles = RoleSet { roles: {} } uri = /metrics/producers
12472024-09-23T23:16:17.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42540 req_id = 20ad2f9a-878e-4ab6-844b-a2fea4155200 resource = Database result = Ok(()) uri = /metrics/producers
12482024-09-23T23:16:17.092ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
12492024-09-23T23:16:17.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42540 req_id = 20ad2f9a-878e-4ab6-844b-a2fea4155200 roles = RoleSet { roles: {} } uri = /metrics/producers
12502024-09-23T23:16:17.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42540 req_id = 20ad2f9a-878e-4ab6-844b-a2fea4155200 resource = Database result = Ok(()) uri = /metrics/producers
12512024-09-23T23:16:17.153ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
12522024-09-23T23:16:17.154ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "07ad8f58-d508-4988-bb00-4cbd907bf2a3", "date": "Mon, 23 Sep 2024 23:16:16 GMT"} })
12532024-09-23T23:16:17.154ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = 33a0a3ef-fb4e-4eb6-bc0e-5a150e0c94ea
12542024-09-23T23:16:17.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95505 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42540 req_id = 20ad2f9a-878e-4ab6-844b-a2fea4155200 response_code = 201 uri = /metrics/producers
12552024-09-23T23:16:17.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
12562024-09-23T23:16:17.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12572024-09-23T23:16:17.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12582024-09-23T23:16:17.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5a78af3f-3e91-4986-931c-069870a0a6bc roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12592024-09-23T23:16:17.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5a78af3f-3e91-4986-931c-069870a0a6bc resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12602024-09-23T23:16:17.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5a78af3f-3e91-4986-931c-069870a0a6bc response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12612024-09-23T23:16:17.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
12622024-09-23T23:16:17.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12632024-09-23T23:16:17.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12642024-09-23T23:16:17.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12652024-09-23T23:16:17.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12662024-09-23T23:16:17.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12672024-09-23T23:16:17.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12682024-09-23T23:16:17.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12692024-09-23T23:16:17.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12702024-09-23T23:16:17.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12712024-09-23T23:16:17.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12722024-09-23T23:16:17.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12732024-09-23T23:16:17.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
12742024-09-23T23:16:17.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12752024-09-23T23:16:17.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12762024-09-23T23:16:17.850ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
12772024-09-23T23:16:17.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.487639ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
12782024-09-23T23:16:17.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.038654ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12792024-09-23T23:16:18.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 40acd73f-306a-48ac-bd44-73c7a11423da roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12802024-09-23T23:16:18.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 40acd73f-306a-48ac-bd44-73c7a11423da resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12812024-09-23T23:16:18.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 40acd73f-306a-48ac-bd44-73c7a11423da response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12822024-09-23T23:16:19.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bc46619a-0e60-429e-99c0-7c007f389811 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12832024-09-23T23:16:19.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bc46619a-0e60-429e-99c0-7c007f389811 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12842024-09-23T23:16:19.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bc46619a-0e60-429e-99c0-7c007f389811 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12852024-09-23T23:16:20.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5ea0f304-4e4d-4453-acdb-e2603a28bf37 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12862024-09-23T23:16:20.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5ea0f304-4e4d-4453-acdb-e2603a28bf37 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12872024-09-23T23:16:20.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5ea0f304-4e4d-4453-acdb-e2603a28bf37 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12882024-09-23T23:16:21.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 25e3d778-cec9-4836-bbf4-06a15c452850 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12892024-09-23T23:16:21.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 25e3d778-cec9-4836-bbf4-06a15c452850 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12902024-09-23T23:16:21.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 25e3d778-cec9-4836-bbf4-06a15c452850 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12912024-09-23T23:16:22.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2d3850d6-0047-4e19-8a3f-f5db4258d396 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12922024-09-23T23:16:22.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2d3850d6-0047-4e19-8a3f-f5db4258d396 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12932024-09-23T23:16:22.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2d3850d6-0047-4e19-8a3f-f5db4258d396 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12942024-09-23T23:16:23.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3e8a79c5-fa60-4539-b6ce-f5e5e6c1a8a7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12952024-09-23T23:16:23.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3e8a79c5-fa60-4539-b6ce-f5e5e6c1a8a7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12962024-09-23T23:16:23.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3e8a79c5-fa60-4539-b6ce-f5e5e6c1a8a7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12972024-09-23T23:16:24.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9282bd74-f833-4ae3-8552-3a7a732e867c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12982024-09-23T23:16:24.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9282bd74-f833-4ae3-8552-3a7a732e867c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
12992024-09-23T23:16:24.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9282bd74-f833-4ae3-8552-3a7a732e867c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13002024-09-23T23:16:25.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 517802d2-4578-4389-93bd-a0f1b1cd1d90 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13012024-09-23T23:16:25.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 517802d2-4578-4389-93bd-a0f1b1cd1d90 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13022024-09-23T23:16:25.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 517802d2-4578-4389-93bd-a0f1b1cd1d90 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13032024-09-23T23:16:26.069ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 51a4410b-318e-4410-a413-1dd6182b7bb5 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
13042024-09-23T23:16:27.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 679fa68a-9a66-494f-9c38-422734a95276 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13052024-09-23T23:16:27.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 679fa68a-9a66-494f-9c38-422734a95276 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13062024-09-23T23:16:27.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 679fa68a-9a66-494f-9c38-422734a95276 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13072024-09-23T23:16:27.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
13082024-09-23T23:16:27.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13092024-09-23T23:16:27.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13102024-09-23T23:16:27.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
13112024-09-23T23:16:27.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13122024-09-23T23:16:27.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13132024-09-23T23:16:27.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13142024-09-23T23:16:27.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13152024-09-23T23:16:27.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13162024-09-23T23:16:27.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13172024-09-23T23:16:27.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13182024-09-23T23:16:27.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13192024-09-23T23:16:27.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.753033ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13202024-09-23T23:16:27.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13212024-09-23T23:16:27.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13222024-09-23T23:16:27.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232024-09-23T23:16:27.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
13242024-09-23T23:16:27.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13252024-09-23T23:16:27.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13262024-09-23T23:16:27.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
13272024-09-23T23:16:27.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.848184ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
13282024-09-23T23:16:28.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e611a6b0-9c8b-47ba-802a-3fb7392b2908 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13292024-09-23T23:16:28.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e611a6b0-9c8b-47ba-802a-3fb7392b2908 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13302024-09-23T23:16:28.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e611a6b0-9c8b-47ba-802a-3fb7392b2908 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13312024-09-23T23:16:29.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8d6005f1-f358-4530-8844-61f8ea7d58ef roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13322024-09-23T23:16:29.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8d6005f1-f358-4530-8844-61f8ea7d58ef resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13332024-09-23T23:16:29.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8d6005f1-f358-4530-8844-61f8ea7d58ef response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13342024-09-23T23:16:30.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c02cb676-0ba1-4436-b1e5-5b3c3eb3e5bd roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13352024-09-23T23:16:30.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c02cb676-0ba1-4436-b1e5-5b3c3eb3e5bd resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13362024-09-23T23:16:30.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c02cb676-0ba1-4436-b1e5-5b3c3eb3e5bd response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13372024-09-23T23:16:31.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 52ef4369-5d8d-40aa-acf8-072a7dd96035 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13382024-09-23T23:16:31.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 52ef4369-5d8d-40aa-acf8-072a7dd96035 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13392024-09-23T23:16:31.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 52ef4369-5d8d-40aa-acf8-072a7dd96035 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13402024-09-23T23:16:32.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5dac7c6b-1b34-4d7c-bcee-2cde77203d23 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13412024-09-23T23:16:32.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5dac7c6b-1b34-4d7c-bcee-2cde77203d23 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13422024-09-23T23:16:32.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5dac7c6b-1b34-4d7c-bcee-2cde77203d23 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13432024-09-23T23:16:33.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2097c288-3887-4674-88de-201b747b5d14 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13442024-09-23T23:16:33.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2097c288-3887-4674-88de-201b747b5d14 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13452024-09-23T23:16:33.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2097c288-3887-4674-88de-201b747b5d14 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13462024-09-23T23:16:34.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f7f39ba8-7186-46f5-a138-f9e607f87c5d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13472024-09-23T23:16:34.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f7f39ba8-7186-46f5-a138-f9e607f87c5d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13482024-09-23T23:16:34.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f7f39ba8-7186-46f5-a138-f9e607f87c5d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13492024-09-23T23:16:35.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c1a70e21-4a9a-4583-8ebb-7f876266022f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13502024-09-23T23:16:35.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c1a70e21-4a9a-4583-8ebb-7f876266022f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13512024-09-23T23:16:35.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c1a70e21-4a9a-4583-8ebb-7f876266022f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13522024-09-23T23:16:36.068ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1366 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 234c4a61-f477-439f-8a89-185d52fb110b response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
13532024-09-23T23:16:36.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cc74b3ec-38cf-4704-bbb8-d2deff8979fa roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13542024-09-23T23:16:36.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cc74b3ec-38cf-4704-bbb8-d2deff8979fa resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13552024-09-23T23:16:36.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cc74b3ec-38cf-4704-bbb8-d2deff8979fa response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13562024-09-23T23:16:37.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8299cadc-2e90-4491-83e4-5bc96d196351 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13572024-09-23T23:16:37.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8299cadc-2e90-4491-83e4-5bc96d196351 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13582024-09-23T23:16:37.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8299cadc-2e90-4491-83e4-5bc96d196351 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
13592024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
13602024-09-23T23:16:37.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-23 23:06:37.801512122 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13612024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13622024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
13632024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13642024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
13652024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
13662024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
13672024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13682024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13692024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
13702024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
13712024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13722024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
13732024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
13742024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13752024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13762024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
13772024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13782024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
13792024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
13802024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13812024-09-23T23:16:37.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82
13822024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.81\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82"}
13832024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
13842024-09-23T23:16:37.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13852024-09-23T23:16:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13862024-09-23T23:16:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13872024-09-23T23:16:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13882024-09-23T23:16:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13892024-09-23T23:16:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13902024-09-23T23:16:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13912024-09-23T23:16:37.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("954a3d10-a2dd-433b-9252-ede695863bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 688135932 } })
13922024-09-23T23:16:37.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65799211-2178-4ef6-a14b-629ea048347e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2729181-3180-4ecf-bd42-a48f1144b71d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 688256743 } })
13932024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
13942024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
13952024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13962024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13972024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13982024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
13992024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14002024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
14012024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14022024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
14032024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14042024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
14052024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
14062024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14072024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
14082024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14092024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14102024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
14112024-09-23T23:16:37.803ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
14122024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14132024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
14142024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14152024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14162024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
14172024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14182024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
14192024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14202024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
14212024-09-23T23:16:37.804ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14222024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14232024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
14242024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14252024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14262024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14272024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14282024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14292024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14302024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14312024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14322024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14332024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14342024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14352024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14362024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14372024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14382024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14392024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14402024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
14412024-09-23T23:16:37.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.025775ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
14422024-09-23T23:16:37.805ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-23 23:06:37.801512122 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14432024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.790134ms iteration = 5 status = {"expiration":"2024-09-23T23:06:37.801512122Z","pruned":[]}
14442024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
14452024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14462024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14472024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
14482024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14492024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14502024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14512024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
14522024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.300499ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
14532024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14542024-09-23T23:16:37.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14552024-09-23T23:16:37.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.741595ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14562024-09-23T23:16:37.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14572024-09-23T23:16:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14582024-09-23T23:16:37.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 692980818 } })
14592024-09-23T23:16:37.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 693020908 } })
14602024-09-23T23:16:37.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14612024-09-23T23:16:37.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
14622024-09-23T23:16:37.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14632024-09-23T23:16:37.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14642024-09-23T23:16:37.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14652024-09-23T23:16:37.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14662024-09-23T23:16:37.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14672024-09-23T23:16:37.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
14682024-09-23T23:16:37.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14692024-09-23T23:16:37.814ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.500951ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
14702024-09-23T23:16:37.847ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14712024-09-23T23:16:37.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14722024-09-23T23:16:37.850ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14732024-09-23T23:16:37.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14742024-09-23T23:16:37.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14752024-09-23T23:16:37.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762024-09-23T23:16:37.852ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14772024-09-23T23:16:37.852ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14782024-09-23T23:16:37.852ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 48.478409ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14792024-09-23T23:16:37.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14802024-09-23T23:16:37.853ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14812024-09-23T23:16:37.853ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14822024-09-23T23:16:37.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14832024-09-23T23:16:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14842024-09-23T23:16:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14852024-09-23T23:16:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14862024-09-23T23:16:37.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14872024-09-23T23:16:37.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14882024-09-23T23:16:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14892024-09-23T23:16:37.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14902024-09-23T23:16:37.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14912024-09-23T23:16:37.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14922024-09-23T23:16:37.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14932024-09-23T23:16:37.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14942024-09-23T23:16:37.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14952024-09-23T23:16:37.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.335833ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
14962024-09-23T23:16:37.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14972024-09-23T23:16:37.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.535156ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14982024-09-23T23:16:37.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14992024-09-23T23:16:37.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15002024-09-23T23:16:37.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15012024-09-23T23:16:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15022024-09-23T23:16:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15032024-09-23T23:16:37.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15042024-09-23T23:16:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15052024-09-23T23:16:37.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15062024-09-23T23:16:37.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.265605ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
15072024-09-23T23:16:37.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15082024-09-23T23:16:37.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15092024-09-23T23:16:37.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15102024-09-23T23:16:37.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15112024-09-23T23:16:37.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15122024-09-23T23:16:37.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15132024-09-23T23:16:37.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15142024-09-23T23:16:37.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15152024-09-23T23:16:37.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15162024-09-23T23:16:37.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15172024-09-23T23:16:37.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15182024-09-23T23:16:37.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15192024-09-23T23:16:37.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202024-09-23T23:16:37.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15212024-09-23T23:16:37.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222024-09-23T23:16:37.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1197, tv_nsec: 756643812 } })
15232024-09-23T23:16:37.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
15242024-09-23T23:16:37.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15252024-09-23T23:16:37.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15262024-09-23T23:16:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15272024-09-23T23:16:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15282024-09-23T23:16:37.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15292024-09-23T23:16:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15302024-09-23T23:16:37.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
15312024-09-23T23:16:37.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15322024-09-23T23:16:37.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15332024-09-23T23:16:37.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15342024-09-23T23:16:37.888ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
15352024-09-23T23:16:37.888ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.517087ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
15362024-09-23T23:16:37.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15372024-09-23T23:16:37.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15382024-09-23T23:16:37.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15392024-09-23T23:16:37.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15402024-09-23T23:16:37.895ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15412024-09-23T23:16:37.896ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15422024-09-23T23:16:37.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15432024-09-23T23:16:37.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15442024-09-23T23:16:37.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15452024-09-23T23:16:37.897ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
15462024-09-23T23:16:37.897ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 93.916543ms iteration = 5 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
15472024-09-23T23:16:37.898ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15482024-09-23T23:16:37.898ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15492024-09-23T23:16:37.898ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 94.039424ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15502024-09-23T23:16:37.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
15512024-09-23T23:16:37.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15522024-09-23T23:16:37.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15532024-09-23T23:16:37.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.625865ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15542024-09-23T23:16:37.902ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.382344ms iteration = 9 status = 0
15552024-09-23T23:16:37.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15562024-09-23T23:16:37.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15572024-09-23T23:16:37.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15582024-09-23T23:16:37.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15592024-09-23T23:16:37.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15602024-09-23T23:16:37.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15612024-09-23T23:16:37.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622024-09-23T23:16:37.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15632024-09-23T23:16:37.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15642024-09-23T23:16:37.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15652024-09-23T23:16:37.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15662024-09-23T23:16:37.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 111.685207ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15672024-09-23T23:16:37.916ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15682024-09-23T23:16:37.916ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15692024-09-23T23:16:37.916ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15702024-09-23T23:16:37.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15712024-09-23T23:16:37.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15722024-09-23T23:16:37.918ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15732024-09-23T23:16:37.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15742024-09-23T23:16:37.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15752024-09-23T23:16:37.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15762024-09-23T23:16:37.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15772024-09-23T23:16:37.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15782024-09-23T23:16:37.920ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15792024-09-23T23:16:37.920ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15802024-09-23T23:16:37.920ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15812024-09-23T23:16:37.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15822024-09-23T23:16:37.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15832024-09-23T23:16:37.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15842024-09-23T23:16:37.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15852024-09-23T23:16:37.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15862024-09-23T23:16:37.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15872024-09-23T23:16:37.925ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15882024-09-23T23:16:37.925ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 121.397539ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15892024-09-23T23:16:37.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902024-09-23T23:16:37.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15912024-09-23T23:16:37.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15922024-09-23T23:16:37.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15932024-09-23T23:16:37.935ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15942024-09-23T23:16:37.935ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 0 version = 2
15952024-09-23T23:16:37.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15962024-09-23T23:16:37.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15972024-09-23T23:16:37.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15982024-09-23T23:16:37.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15992024-09-23T23:16:37.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16002024-09-23T23:16:37.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16012024-09-23T23:16:37.946ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 1 version = 2
16022024-09-23T23:16:37.946ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16032024-09-23T23:16:37.946ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-23 23:12:40.294485 UTC dns_group = external generation = 2
16042024-09-23T23:16:37.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 144.444974ms iteration = 6 status = {"generation":2}
16052024-09-23T23:16:37.948ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16062024-09-23T23:16:37.948ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16072024-09-23T23:16:37.948ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.114462ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16082024-09-23T23:16:37.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16092024-09-23T23:16:37.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16102024-09-23T23:16:37.973ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
16112024-09-23T23:16:37.973ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16122024-09-23T23:16:37.973ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "39c832c8-24e8-47fd-a69d-644a22bfc8ee", "content-length": "26", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} })
16132024-09-23T23:16:37.973ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16142024-09-23T23:16:37.977ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16152024-09-23T23:16:37.977ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-23T23:12:36.221760Z, time_modified: 2024-09-23T23:12:36.221760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }) }
16162024-09-23T23:16:37.977ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 176.09844ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]}},"default_endpoint":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16172024-09-23T23:16:37.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 176.737537ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16182024-09-23T23:16:38.023ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
16192024-09-23T23:16:38.023ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
16202024-09-23T23:16:38.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16212024-09-23T23:16:38.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16222024-09-23T23:16:38.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16232024-09-23T23:16:38.031ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
16242024-09-23T23:16:38.031ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16252024-09-23T23:16:38.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16262024-09-23T23:16:38.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16272024-09-23T23:16:38.032ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4baa3bd0-570a-4d54-a69f-af0844144da8", "content-length": "26", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} })
16282024-09-23T23:16:38.032ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16292024-09-23T23:16:38.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16302024-09-23T23:16:38.034ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16312024-09-23T23:16:38.038ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
16322024-09-23T23:16:38.038ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16332024-09-23T23:16:38.038ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-23 23:12:39.428682 UTC dns_group = internal generation = 1
16342024-09-23T23:16:38.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 236.629697ms iteration = 6 status = {"generation":1}
16352024-09-23T23:16:38.062ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16362024-09-23T23:16:38.075ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16372024-09-23T23:16:38.076ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "51bc893f-785a-4aa0-819c-092237248639", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16382024-09-23T23:16:38.076ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16392024-09-23T23:16:38.077ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "01ba91a8-78ef-4481-b19f-7c71651ed47c", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16402024-09-23T23:16:38.077ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16412024-09-23T23:16:38.079ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16422024-09-23T23:16:38.079ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 278.172725ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16432024-09-23T23:16:38.096ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
16442024-09-23T23:16:38.096ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16452024-09-23T23:16:38.098ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f0571b6-8a25-4546-8b10-edd68491177e", "content-length": "26", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} })
16462024-09-23T23:16:38.098ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16472024-09-23T23:16:38.101ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
16482024-09-23T23:16:38.102ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 298.885325ms iteration = 12 status = {"physical_disks_added":0}
16492024-09-23T23:16:38.128ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16502024-09-23T23:16:38.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16512024-09-23T23:16:38.130ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16522024-09-23T23:16:38.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16532024-09-23T23:16:38.132ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16542024-09-23T23:16:38.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16552024-09-23T23:16:38.191ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 390.228107ms iteration = 9 status = {}
16562024-09-23T23:16:38.196ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16572024-09-23T23:16:38.197ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "37e79b32-b1fa-47de-addb-a9cb2392c725", "content-length": "1", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} })
16582024-09-23T23:16:38.199ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16592024-09-23T23:16:38.199ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16602024-09-23T23:16:38.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16612024-09-23T23:16:38.294ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16622024-09-23T23:16:38.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16632024-09-23T23:16:38.297ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16642024-09-23T23:16:38.297ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "40507c28-d180-4c04-bfc9-2d8f9e3aef3d", "date": "Mon, 23 Sep 2024 23:16:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16652024-09-23T23:16:38.297ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16662024-09-23T23:16:38.297ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 496.016526ms iteration = 9 status = null
16672024-09-23T23:16:38.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16682024-09-23T23:16:38.299ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16692024-09-23T23:16:38.299ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9e6fa0a5-378f-4407-890c-cbc9a4fd32b0", "date": "Mon, 23 Sep 2024 23:16:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16702024-09-23T23:16:38.299ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16712024-09-23T23:16:38.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16722024-09-23T23:16:38.301ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "60851b41-914b-45bb-b52a-9b144ab49086", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16732024-09-23T23:16:38.301ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16742024-09-23T23:16:38.303ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16752024-09-23T23:16:38.303ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 501.703082ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16762024-09-23T23:16:38.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a662d1c1-a48c-484a-b07d-2327e4c87856 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
16772024-09-23T23:16:38.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a662d1c1-a48c-484a-b07d-2327e4c87856 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
16782024-09-23T23:16:38.317ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "42bb1717-4134-47b3-97c9-97548c93afdd", "content-length": "372", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} })
16792024-09-23T23:16:38.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16802024-09-23T23:16:38.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16812024-09-23T23:16:38.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a662d1c1-a48c-484a-b07d-2327e4c87856 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
16822024-09-23T23:16:38.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16832024-09-23T23:16:38.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16842024-09-23T23:16:38.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16852024-09-23T23:16:38.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16862024-09-23T23:16:38.327ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16872024-09-23T23:16:38.327ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b3b887ea-5a59-43d3-9830-0e920844e484", "date": "Mon, 23 Sep 2024 23:16:38 GMT"} })
16882024-09-23T23:16:38.329ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 525.8819ms iteration = 10 status = {}
16892024-09-23T23:16:38.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16902024-09-23T23:16:38.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16912024-09-23T23:16:38.400ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16922024-09-23T23:16:38.400ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a64aa9ba-29bb-436a-941e-4bbcaabae97e", "content-length": "691", "date": "Mon, 23 Sep 2024 23:16:38 GMT"} })
16932024-09-23T23:16:38.400ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16942024-09-23T23:16:38.400ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16952024-09-23T23:16:38.400ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16962024-09-23T23:16:38.401ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 597.601767ms iteration = 9 status = {}
16972024-09-23T23:16:38.402ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
16982024-09-23T23:16:38.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16992024-09-23T23:16:38.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17002024-09-23T23:16:38.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17012024-09-23T23:16:38.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7883b506-62f5-4516-9f39-bfc3e69c4754", "content-length": "121", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} })
17022024-09-23T23:16:38.412ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
17032024-09-23T23:16:38.412ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
17042024-09-23T23:16:38.412ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17052024-09-23T23:16:38.412ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17062024-09-23T23:16:38.412ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
17072024-09-23T23:16:38.412ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
17082024-09-23T23:16:38.412ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
17092024-09-23T23:16:38.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17102024-09-23T23:16:38.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17112024-09-23T23:16:38.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17122024-09-23T23:16:38.416ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "05db2e2e-1918-43c3-b8ba-d42436bd23c1", "content-length": "2", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} })
17132024-09-23T23:16:38.416ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17142024-09-23T23:16:38.416ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d03c6f53-03ff-4ec8-8427-372ef2b1872a", "content-length": "52", "date": "Mon, 23 Sep 2024 23:16:37 GMT"} })
17152024-09-23T23:16:38.416ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
17162024-09-23T23:16:38.416ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17172024-09-23T23:16:38.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 3c2a8c46-302f-43c3-8ce7-8a6cd13340fc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17182024-09-23T23:16:38.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 3c2a8c46-302f-43c3-8ce7-8a6cd13340fc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17192024-09-23T23:16:38.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 3c2a8c46-302f-43c3-8ce7-8a6cd13340fc response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17202024-09-23T23:16:38.511ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "64c0c205-2f40-4544-8be0-ee72f0da6fb5", "date": "Mon, 23 Sep 2024 23:16:38 GMT"} })
17212024-09-23T23:16:38.511ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
17222024-09-23T23:16:38.511ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17232024-09-23T23:16:38.512ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7dbe90c3-dc94-4b97-942c-744f5c346761", "content-length": "667", "date": "Mon, 23 Sep 2024 23:16:38 GMT"} })
17242024-09-23T23:16:38.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17252024-09-23T23:16:38.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17262024-09-23T23:16:38.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17272024-09-23T23:16:38.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17282024-09-23T23:16:38.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17292024-09-23T23:16:38.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17302024-09-23T23:16:38.521ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17312024-09-23T23:16:38.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17322024-09-23T23:16:38.528ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 724.854933ms iteration = 9 status = {}
17332024-09-23T23:16:39.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fd4769f5-afb1-4d33-a4ec-507e548edd34 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17342024-09-23T23:16:39.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fd4769f5-afb1-4d33-a4ec-507e548edd34 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17352024-09-23T23:16:39.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2796 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fd4769f5-afb1-4d33-a4ec-507e548edd34 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17362024-09-23T23:16:40.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2f80e54b-7a04-4a21-96cb-3de3bff6449c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17372024-09-23T23:16:40.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2f80e54b-7a04-4a21-96cb-3de3bff6449c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17382024-09-23T23:16:40.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2f80e54b-7a04-4a21-96cb-3de3bff6449c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17392024-09-23T23:16:41.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fccb116d-6e7f-47de-b3bd-68054a76abeb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17402024-09-23T23:16:41.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fccb116d-6e7f-47de-b3bd-68054a76abeb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17412024-09-23T23:16:41.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fccb116d-6e7f-47de-b3bd-68054a76abeb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17422024-09-23T23:16:42.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 78cc607d-3ca4-40c9-9d4d-64f28d975602 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17432024-09-23T23:16:42.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 78cc607d-3ca4-40c9-9d4d-64f28d975602 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17442024-09-23T23:16:42.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 78cc607d-3ca4-40c9-9d4d-64f28d975602 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17452024-09-23T23:16:43.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6b14ea62-5f94-4ff3-8949-8de13e7bd7e9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17462024-09-23T23:16:43.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6b14ea62-5f94-4ff3-8949-8de13e7bd7e9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17472024-09-23T23:16:43.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6b14ea62-5f94-4ff3-8949-8de13e7bd7e9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17482024-09-23T23:16:44.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3a0aa728-2c69-4cf5-8e2f-5e6e91193e59 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17492024-09-23T23:16:44.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3a0aa728-2c69-4cf5-8e2f-5e6e91193e59 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17502024-09-23T23:16:44.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3a0aa728-2c69-4cf5-8e2f-5e6e91193e59 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17512024-09-23T23:16:45.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8bfcb5b1-f887-42a8-b75d-54d8306810b6 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17522024-09-23T23:16:45.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8bfcb5b1-f887-42a8-b75d-54d8306810b6 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17532024-09-23T23:16:45.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8bfcb5b1-f887-42a8-b75d-54d8306810b6 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17542024-09-23T23:16:46.069ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1419 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 5380e38b-dcfc-4ed7-a74a-08d5fd13f566 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
17552024-09-23T23:16:46.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 838e4e55-6629-44c7-a3cb-7f514480b65a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17562024-09-23T23:16:46.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 838e4e55-6629-44c7-a3cb-7f514480b65a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17572024-09-23T23:16:46.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 838e4e55-6629-44c7-a3cb-7f514480b65a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17582024-09-23T23:16:47.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a639761e-79a1-49ea-8f55-ab1e909ab5e0 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17592024-09-23T23:16:47.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a639761e-79a1-49ea-8f55-ab1e909ab5e0 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17602024-09-23T23:16:47.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a639761e-79a1-49ea-8f55-ab1e909ab5e0 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17612024-09-23T23:16:47.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
17622024-09-23T23:16:47.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17632024-09-23T23:16:47.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17642024-09-23T23:16:47.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
17652024-09-23T23:16:47.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17662024-09-23T23:16:47.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17672024-09-23T23:16:47.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17682024-09-23T23:16:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17692024-09-23T23:16:47.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17702024-09-23T23:16:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17712024-09-23T23:16:47.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17722024-09-23T23:16:47.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17732024-09-23T23:16:47.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17742024-09-23T23:16:47.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
17752024-09-23T23:16:47.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17762024-09-23T23:16:47.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17772024-09-23T23:16:47.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
17782024-09-23T23:16:47.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.12434ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
17792024-09-23T23:16:47.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17802024-09-23T23:16:47.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17812024-09-23T23:16:47.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.607638ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17822024-09-23T23:16:48.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9055fa8c-3029-4df5-a732-2a7322dc25d0 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17832024-09-23T23:16:48.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9055fa8c-3029-4df5-a732-2a7322dc25d0 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17842024-09-23T23:16:48.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9055fa8c-3029-4df5-a732-2a7322dc25d0 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17852024-09-23T23:16:49.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f3d4de4d-2183-45f5-8365-2a64b75328c4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17862024-09-23T23:16:49.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f3d4de4d-2183-45f5-8365-2a64b75328c4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17872024-09-23T23:16:49.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f3d4de4d-2183-45f5-8365-2a64b75328c4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17882024-09-23T23:16:50.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 183c0ebb-d64a-43ab-8b21-ad900ea4f725 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17892024-09-23T23:16:50.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 183c0ebb-d64a-43ab-8b21-ad900ea4f725 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17902024-09-23T23:16:50.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 183c0ebb-d64a-43ab-8b21-ad900ea4f725 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17912024-09-23T23:16:51.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e1908904-df3c-452f-a185-afc6b7fe3689 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17922024-09-23T23:16:51.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e1908904-df3c-452f-a185-afc6b7fe3689 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17932024-09-23T23:16:51.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e1908904-df3c-452f-a185-afc6b7fe3689 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17942024-09-23T23:16:52.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a42d163-ea5d-4328-9be7-df91442afe86 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17952024-09-23T23:16:52.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a42d163-ea5d-4328-9be7-df91442afe86 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17962024-09-23T23:16:52.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a42d163-ea5d-4328-9be7-df91442afe86 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17972024-09-23T23:16:53.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 414f0598-5c4f-4a8a-8aac-1a08bde4925b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17982024-09-23T23:16:53.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 414f0598-5c4f-4a8a-8aac-1a08bde4925b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
17992024-09-23T23:16:53.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 414f0598-5c4f-4a8a-8aac-1a08bde4925b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18002024-09-23T23:16:54.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2b0b5606-0140-4ecc-a9c6-1db60d00278a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18012024-09-23T23:16:54.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2b0b5606-0140-4ecc-a9c6-1db60d00278a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18022024-09-23T23:16:54.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2b0b5606-0140-4ecc-a9c6-1db60d00278a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18032024-09-23T23:16:55.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0ccb5df7-e1f5-471f-8907-e8f23b68bc8a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18042024-09-23T23:16:55.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0ccb5df7-e1f5-471f-8907-e8f23b68bc8a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18052024-09-23T23:16:55.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0ccb5df7-e1f5-471f-8907-e8f23b68bc8a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18062024-09-23T23:16:56.068ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1343 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 7db90606-ba31-4581-8722-2decf804676b response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
18072024-09-23T23:16:56.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fd729db8-69b7-44b7-b31d-6641bd00674a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18082024-09-23T23:16:56.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fd729db8-69b7-44b7-b31d-6641bd00674a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18092024-09-23T23:16:56.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fd729db8-69b7-44b7-b31d-6641bd00674a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18102024-09-23T23:16:57.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 83d3e569-ca57-450b-ae4d-b05561976955 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18112024-09-23T23:16:57.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 83d3e569-ca57-450b-ae4d-b05561976955 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18122024-09-23T23:16:57.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 83d3e569-ca57-450b-ae4d-b05561976955 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18132024-09-23T23:16:57.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
18142024-09-23T23:16:57.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18152024-09-23T23:16:57.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18162024-09-23T23:16:57.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172024-09-23T23:16:57.803ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
18182024-09-23T23:16:57.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18192024-09-23T23:16:57.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18202024-09-23T23:16:57.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18212024-09-23T23:16:57.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18222024-09-23T23:16:57.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18232024-09-23T23:16:57.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18242024-09-23T23:16:57.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18252024-09-23T23:16:57.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18262024-09-23T23:16:57.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18272024-09-23T23:16:57.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18282024-09-23T23:16:57.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
18292024-09-23T23:16:57.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18302024-09-23T23:16:57.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18312024-09-23T23:16:57.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
18322024-09-23T23:16:57.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.410001ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
18332024-09-23T23:16:57.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.090737ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18342024-09-23T23:16:58.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a1794522-44de-41af-b1c1-f65c02d2bf94 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18352024-09-23T23:16:58.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a1794522-44de-41af-b1c1-f65c02d2bf94 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18362024-09-23T23:16:58.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a1794522-44de-41af-b1c1-f65c02d2bf94 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18372024-09-23T23:16:59.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d0c79c9a-b930-4795-9b4c-c13c295e4618 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18382024-09-23T23:16:59.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d0c79c9a-b930-4795-9b4c-c13c295e4618 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18392024-09-23T23:16:59.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d0c79c9a-b930-4795-9b4c-c13c295e4618 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18402024-09-23T23:17:00.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0b84a46d-2a10-4109-a9de-87c0b99b8bf2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18412024-09-23T23:17:00.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0b84a46d-2a10-4109-a9de-87c0b99b8bf2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18422024-09-23T23:17:00.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0b84a46d-2a10-4109-a9de-87c0b99b8bf2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18432024-09-23T23:17:01.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a6015580-9bce-4c85-937c-fb7152ffab84 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18442024-09-23T23:17:01.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a6015580-9bce-4c85-937c-fb7152ffab84 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18452024-09-23T23:17:01.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a6015580-9bce-4c85-937c-fb7152ffab84 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18462024-09-23T23:17:02.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6acd6121-123f-42a1-ac8b-367b083720a9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18472024-09-23T23:17:02.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6acd6121-123f-42a1-ac8b-367b083720a9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18482024-09-23T23:17:02.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6acd6121-123f-42a1-ac8b-367b083720a9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18492024-09-23T23:17:03.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 931e4ef3-12fb-4736-a4c6-decc7863ae30 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18502024-09-23T23:17:03.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 931e4ef3-12fb-4736-a4c6-decc7863ae30 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18512024-09-23T23:17:03.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 931e4ef3-12fb-4736-a4c6-decc7863ae30 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18522024-09-23T23:17:04.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eb57004b-9f93-40dd-9df6-021134b326c8 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18532024-09-23T23:17:04.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eb57004b-9f93-40dd-9df6-021134b326c8 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18542024-09-23T23:17:04.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eb57004b-9f93-40dd-9df6-021134b326c8 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18552024-09-23T23:17:05.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d21914c6-771b-49bd-95e6-57c0af349743 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18562024-09-23T23:17:05.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d21914c6-771b-49bd-95e6-57c0af349743 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18572024-09-23T23:17:05.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d21914c6-771b-49bd-95e6-57c0af349743 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18582024-09-23T23:17:06.068ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1396 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = a815843c-2f52-4cab-8634-f8db1478e13a response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
18592024-09-23T23:17:06.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c2977f19-04cc-47f2-a193-51569e4c1914 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18602024-09-23T23:17:06.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c2977f19-04cc-47f2-a193-51569e4c1914 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18612024-09-23T23:17:06.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c2977f19-04cc-47f2-a193-51569e4c1914 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
18622024-09-23T23:17:07.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
18632024-09-23T23:17:07.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
18642024-09-23T23:17:07.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18652024-09-23T23:17:07.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18662024-09-23T23:17:07.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
18672024-09-23T23:17:07.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
18682024-09-23T23:17:07.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18692024-09-23T23:17:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18702024-09-23T23:17:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18712024-09-23T23:17:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18722024-09-23T23:17:07.803ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
18732024-09-23T23:17:07.803ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
18742024-09-23T23:17:07.803ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
18752024-09-23T23:17:07.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18762024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18772024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18782024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
18792024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18802024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
18812024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18822024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
18832024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
18842024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18852024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18862024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
18872024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18882024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
18892024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18902024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18912024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
18922024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18932024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
18942024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18952024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18962024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18972024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18982024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18992024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19002024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19012024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19022024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19032024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19042024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19052024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19062024-09-23T23:17:07.804ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 690497519 } })
19072024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
19082024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19092024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
19102024-09-23T23:17:07.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19112024-09-23T23:17:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19122024-09-23T23:17:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19132024-09-23T23:17:07.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19142024-09-23T23:17:07.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 691459060 } })
19152024-09-23T23:17:07.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
19162024-09-23T23:17:07.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19172024-09-23T23:17:07.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182024-09-23T23:17:07.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
19192024-09-23T23:17:07.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.852856ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19202024-09-23T23:17:07.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19212024-09-23T23:17:07.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19222024-09-23T23:17:07.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19232024-09-23T23:17:07.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19242024-09-23T23:17:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19252024-09-23T23:17:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19262024-09-23T23:17:07.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19272024-09-23T23:17:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19282024-09-23T23:17:07.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19292024-09-23T23:17:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19302024-09-23T23:17:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19312024-09-23T23:17:07.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19322024-09-23T23:17:07.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19332024-09-23T23:17:07.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19342024-09-23T23:17:07.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19352024-09-23T23:17:07.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362024-09-23T23:17:07.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.716017ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
19372024-09-23T23:17:07.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19382024-09-23T23:17:07.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19392024-09-23T23:17:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19402024-09-23T23:17:07.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19412024-09-23T23:17:07.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19422024-09-23T23:17:07.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19432024-09-23T23:17:07.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19442024-09-23T23:17:07.827ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 713424593 } })
19452024-09-23T23:17:07.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19462024-09-23T23:17:07.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19472024-09-23T23:17:07.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
19482024-09-23T23:17:07.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19492024-09-23T23:17:07.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19502024-09-23T23:17:07.844ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19512024-09-23T23:17:07.844ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19522024-09-23T23:17:07.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19532024-09-23T23:17:07.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19542024-09-23T23:17:07.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19552024-09-23T23:17:07.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19562024-09-23T23:17:07.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19572024-09-23T23:17:07.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19582024-09-23T23:17:07.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19592024-09-23T23:17:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19602024-09-23T23:17:07.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19612024-09-23T23:17:07.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19622024-09-23T23:17:07.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19632024-09-23T23:17:07.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19642024-09-23T23:17:07.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
19652024-09-23T23:17:07.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19662024-09-23T23:17:07.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19672024-09-23T23:17:07.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19682024-09-23T23:17:07.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19692024-09-23T23:17:07.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702024-09-23T23:17:07.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19712024-09-23T23:17:07.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19722024-09-23T23:17:07.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19732024-09-23T23:17:07.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19742024-09-23T23:17:07.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19752024-09-23T23:17:07.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19762024-09-23T23:17:07.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19772024-09-23T23:17:07.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19782024-09-23T23:17:07.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.634495ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19792024-09-23T23:17:07.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.691976ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
19802024-09-23T23:17:07.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
19812024-09-23T23:17:07.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.731103ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
19822024-09-23T23:17:07.880ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19832024-09-23T23:17:07.880ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.976325ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19842024-09-23T23:17:07.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.35539ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19852024-09-23T23:17:07.887ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19862024-09-23T23:17:07.887ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19872024-09-23T23:17:07.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19882024-09-23T23:17:07.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19892024-09-23T23:17:07.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.517339ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19902024-09-23T23:17:07.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19912024-09-23T23:17:07.895ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
19922024-09-23T23:17:07.895ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19932024-09-23T23:17:07.895ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5b07e88b-0158-469f-80d0-d5f758aa37f5", "content-length": "26", "date": "Mon, 23 Sep 2024 23:17:07 GMT"} })
19942024-09-23T23:17:07.895ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19952024-09-23T23:17:07.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
19962024-09-23T23:17:07.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19972024-09-23T23:17:07.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19982024-09-23T23:17:07.897ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19992024-09-23T23:17:07.901ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.952129ms iteration = 10 status = 0
20002024-09-23T23:17:07.908ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
20012024-09-23T23:17:07.908ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20022024-09-23T23:17:07.909ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71b32dcf-b3ea-4a01-92bc-91eb3298644c", "content-length": "26", "date": "Mon, 23 Sep 2024 23:17:07 GMT"} })
20032024-09-23T23:17:07.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20042024-09-23T23:17:07.909ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.351424ms iteration = 13 status = {"physical_disks_added":0}
20052024-09-23T23:17:07.910ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20062024-09-23T23:17:07.916ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20072024-09-23T23:17:07.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20082024-09-23T23:17:07.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
20092024-09-23T23:17:07.921ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20102024-09-23T23:17:07.921ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e6bc22f-ce15-4a93-b014-b1fd7bc2578c", "content-length": "26", "date": "Mon, 23 Sep 2024 23:17:07 GMT"} })
20112024-09-23T23:17:07.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20122024-09-23T23:17:07.923ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
20132024-09-23T23:17:07.928ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20142024-09-23T23:17:07.928ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20152024-09-23T23:17:07.928ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.543455ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20162024-09-23T23:17:07.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20172024-09-23T23:17:07.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20182024-09-23T23:17:07.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 155.223009ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
20192024-09-23T23:17:07.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dfd54d73-9c4f-4e9b-98cc-c8984546cf7e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
20202024-09-23T23:17:07.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dfd54d73-9c4f-4e9b-98cc-c8984546cf7e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
20212024-09-23T23:17:07.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dfd54d73-9c4f-4e9b-98cc-c8984546cf7e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
20222024-09-23T23:17:08.017ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 215.631595ms iteration = 10 status = {}
20232024-09-23T23:17:08.025ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20242024-09-23T23:17:08.026ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "88c25ae6-ecf4-4fe0-90ba-a769c22e72ef", "content-length": "1", "date": "Mon, 23 Sep 2024 23:17:07 GMT"} })
20252024-09-23T23:17:08.028ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20262024-09-23T23:17:08.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20272024-09-23T23:17:08.030ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 229.08388ms iteration = 10 status = null
20282024-09-23T23:17:08.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20292024-09-23T23:17:08.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20302024-09-23T23:17:08.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20312024-09-23T23:17:08.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20322024-09-23T23:17:08.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20332024-09-23T23:17:08.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20342024-09-23T23:17:08.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20352024-09-23T23:17:08.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20362024-09-23T23:17:08.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20372024-09-23T23:17:08.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20382024-09-23T23:17:08.103ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20392024-09-23T23:17:08.130ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1010a699-67ce-485b-83d2-9df2afd1955f", "content-length": "372", "date": "Mon, 23 Sep 2024 23:17:08 GMT"} })
20402024-09-23T23:17:08.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20412024-09-23T23:17:08.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20422024-09-23T23:17:08.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20432024-09-23T23:17:08.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20442024-09-23T23:17:08.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20452024-09-23T23:17:08.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20462024-09-23T23:17:08.140ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20472024-09-23T23:17:08.140ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3753ec55-9205-427a-8e21-59b8fef14b81", "date": "Mon, 23 Sep 2024 23:17:08 GMT"} })
20482024-09-23T23:17:08.142ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 338.982087ms iteration = 11 status = {}
20492024-09-23T23:17:08.171ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20502024-09-23T23:17:08.171ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ff0c4490-1952-488e-a527-a1070d53279f", "content-length": "691", "date": "Mon, 23 Sep 2024 23:17:08 GMT"} })
20512024-09-23T23:17:08.171ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20522024-09-23T23:17:08.171ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20532024-09-23T23:17:08.172ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20542024-09-23T23:17:08.172ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 368.845871ms iteration = 10 status = {}
20552024-09-23T23:17:08.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20562024-09-23T23:17:08.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20572024-09-23T23:17:08.195ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
20582024-09-23T23:17:08.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20592024-09-23T23:17:08.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20602024-09-23T23:17:08.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20612024-09-23T23:17:08.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "09f03b17-782f-40a3-a928-47abf2df7ebb", "content-length": "121", "date": "Mon, 23 Sep 2024 23:17:07 GMT"} })
20622024-09-23T23:17:08.204ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
20632024-09-23T23:17:08.204ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
20642024-09-23T23:17:08.205ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20652024-09-23T23:17:08.205ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20662024-09-23T23:17:08.205ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
20672024-09-23T23:17:08.205ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
20682024-09-23T23:17:08.205ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
20692024-09-23T23:17:08.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20702024-09-23T23:17:08.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20712024-09-23T23:17:08.207ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20722024-09-23T23:17:08.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e8bc8b9e-53cf-45a7-8ec9-8b10ffcf3a33", "content-length": "2", "date": "Mon, 23 Sep 2024 23:17:07 GMT"} })
20732024-09-23T23:17:08.207ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20742024-09-23T23:17:08.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "054cdfa0-176d-404a-80ae-d9f59179b090", "content-length": "52", "date": "Mon, 23 Sep 2024 23:17:07 GMT"} })
20752024-09-23T23:17:08.207ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
20762024-09-23T23:17:08.207ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20772024-09-23T23:17:08.306ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7de8dc4a-0a2c-4661-9acf-cfeafc4c283e", "date": "Mon, 23 Sep 2024 23:17:07 GMT"} })
20782024-09-23T23:17:08.306ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
20792024-09-23T23:17:08.306ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20802024-09-23T23:17:08.402ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f685455-f20f-4f00-a721-3b1c89baf3f7", "content-length": "667", "date": "Mon, 23 Sep 2024 23:17:07 GMT"} })
20812024-09-23T23:17:08.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20822024-09-23T23:17:08.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20832024-09-23T23:17:08.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20842024-09-23T23:17:08.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20852024-09-23T23:17:08.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20862024-09-23T23:17:08.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20872024-09-23T23:17:08.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20882024-09-23T23:17:08.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20892024-09-23T23:17:08.419ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 615.085499ms iteration = 10 status = {}
20902024-09-23T23:17:08.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 5730ac77-bc20-4ba1-a383-75970ba89219 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
20912024-09-23T23:17:08.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 5730ac77-bc20-4ba1-a383-75970ba89219 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
20922024-09-23T23:17:08.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 5730ac77-bc20-4ba1-a383-75970ba89219 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
20932024-09-23T23:17:08.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2e54cc21-f479-4068-9429-4e434d6a54b1 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
20942024-09-23T23:17:08.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2e54cc21-f479-4068-9429-4e434d6a54b1 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
20952024-09-23T23:17:08.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2e54cc21-f479-4068-9429-4e434d6a54b1 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
20962024-09-23T23:17:10.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 320510f6-de41-4491-8315-c8def7af7ec6 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
20972024-09-23T23:17:10.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 320510f6-de41-4491-8315-c8def7af7ec6 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
20982024-09-23T23:17:10.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 320510f6-de41-4491-8315-c8def7af7ec6 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
20992024-09-23T23:17:11.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ee33780d-3533-4691-aa3c-d5c2028272e4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21002024-09-23T23:17:11.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ee33780d-3533-4691-aa3c-d5c2028272e4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21012024-09-23T23:17:11.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ee33780d-3533-4691-aa3c-d5c2028272e4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21022024-09-23T23:17:12.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e9f56c5d-ca80-4412-8d5f-107a0c9c9582 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21032024-09-23T23:17:12.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e9f56c5d-ca80-4412-8d5f-107a0c9c9582 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21042024-09-23T23:17:12.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e9f56c5d-ca80-4412-8d5f-107a0c9c9582 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21052024-09-23T23:17:13.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = aafd5a22-8813-4aa7-b7f9-c5da7287ffa6 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21062024-09-23T23:17:13.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = aafd5a22-8813-4aa7-b7f9-c5da7287ffa6 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21072024-09-23T23:17:13.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = aafd5a22-8813-4aa7-b7f9-c5da7287ffa6 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21082024-09-23T23:17:14.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 71e1ede8-642c-4412-b18f-fb71bd9ea75c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21092024-09-23T23:17:14.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 71e1ede8-642c-4412-b18f-fb71bd9ea75c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21102024-09-23T23:17:14.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 71e1ede8-642c-4412-b18f-fb71bd9ea75c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21112024-09-23T23:17:15.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a4eff240-ecbc-449f-8a59-49db0a38c1bf roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21122024-09-23T23:17:15.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a4eff240-ecbc-449f-8a59-49db0a38c1bf resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21132024-09-23T23:17:15.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a4eff240-ecbc-449f-8a59-49db0a38c1bf response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21142024-09-23T23:17:16.068ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1371 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 9bce508e-017f-4a4c-8874-7627f5f09a84 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
21152024-09-23T23:17:16.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a5b09088-759a-452d-8300-6708cc554e64 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21162024-09-23T23:17:16.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a5b09088-759a-452d-8300-6708cc554e64 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21172024-09-23T23:17:16.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a5b09088-759a-452d-8300-6708cc554e64 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21182024-09-23T23:17:17.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e02c5a31-8e99-451d-bcd4-cc5308a4a04c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21192024-09-23T23:17:17.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e02c5a31-8e99-451d-bcd4-cc5308a4a04c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21202024-09-23T23:17:17.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e02c5a31-8e99-451d-bcd4-cc5308a4a04c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21212024-09-23T23:17:17.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
21222024-09-23T23:17:17.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21232024-09-23T23:17:17.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21242024-09-23T23:17:17.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
21252024-09-23T23:17:17.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21262024-09-23T23:17:17.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21272024-09-23T23:17:17.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21282024-09-23T23:17:17.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21292024-09-23T23:17:17.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21302024-09-23T23:17:17.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21312024-09-23T23:17:17.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21322024-09-23T23:17:17.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21332024-09-23T23:17:17.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21342024-09-23T23:17:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
21352024-09-23T23:17:17.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21362024-09-23T23:17:17.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21372024-09-23T23:17:17.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
21382024-09-23T23:17:17.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.104204ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
21392024-09-23T23:17:17.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21402024-09-23T23:17:17.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21412024-09-23T23:17:17.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.03612ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21422024-09-23T23:17:18.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eef71ab7-75c0-41b7-8f78-730a14aa5184 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21432024-09-23T23:17:18.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eef71ab7-75c0-41b7-8f78-730a14aa5184 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21442024-09-23T23:17:18.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eef71ab7-75c0-41b7-8f78-730a14aa5184 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21452024-09-23T23:17:19.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 10bdae43-c342-4128-b072-5bf14adaa598 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21462024-09-23T23:17:19.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 10bdae43-c342-4128-b072-5bf14adaa598 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21472024-09-23T23:17:19.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 10bdae43-c342-4128-b072-5bf14adaa598 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21482024-09-23T23:17:20.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b500f8a8-766c-4995-87e2-8a8619305803 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21492024-09-23T23:17:20.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b500f8a8-766c-4995-87e2-8a8619305803 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21502024-09-23T23:17:20.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b500f8a8-766c-4995-87e2-8a8619305803 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21512024-09-23T23:17:21.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 626ff56e-8b40-420a-8b8c-c2e04c078959 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21522024-09-23T23:17:21.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 626ff56e-8b40-420a-8b8c-c2e04c078959 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21532024-09-23T23:17:21.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 626ff56e-8b40-420a-8b8c-c2e04c078959 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21542024-09-23T23:17:22.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 67879f99-94e7-4711-8f5a-b93fd91489c6 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21552024-09-23T23:17:22.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 67879f99-94e7-4711-8f5a-b93fd91489c6 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21562024-09-23T23:17:22.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 67879f99-94e7-4711-8f5a-b93fd91489c6 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21572024-09-23T23:17:23.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a5c75d0-c569-4e32-96bf-73a0dd82b6f2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21582024-09-23T23:17:23.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a5c75d0-c569-4e32-96bf-73a0dd82b6f2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21592024-09-23T23:17:23.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a5c75d0-c569-4e32-96bf-73a0dd82b6f2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21602024-09-23T23:17:24.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9b37af78-213f-44b8-bdb2-acfd0b61015b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21612024-09-23T23:17:24.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9b37af78-213f-44b8-bdb2-acfd0b61015b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21622024-09-23T23:17:24.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9b37af78-213f-44b8-bdb2-acfd0b61015b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21632024-09-23T23:17:25.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 605208b8-e2cc-42c0-a08f-a9c744a1bd7d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21642024-09-23T23:17:25.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 605208b8-e2cc-42c0-a08f-a9c744a1bd7d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21652024-09-23T23:17:25.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 605208b8-e2cc-42c0-a08f-a9c744a1bd7d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21662024-09-23T23:17:26.068ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1460 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 8285c47c-15d6-4eee-8e34-0c91670f8902 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
21672024-09-23T23:17:26.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 91a70cc7-3f37-4f60-8fa3-64621992083b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21682024-09-23T23:17:26.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 91a70cc7-3f37-4f60-8fa3-64621992083b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21692024-09-23T23:17:26.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 91a70cc7-3f37-4f60-8fa3-64621992083b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21702024-09-23T23:17:27.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a3ec7158-2dc5-4487-ac44-75ab51a1bdaf roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21712024-09-23T23:17:27.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a3ec7158-2dc5-4487-ac44-75ab51a1bdaf resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21722024-09-23T23:17:27.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a3ec7158-2dc5-4487-ac44-75ab51a1bdaf response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21732024-09-23T23:17:27.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
21742024-09-23T23:17:27.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21752024-09-23T23:17:27.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21762024-09-23T23:17:27.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21772024-09-23T23:17:27.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
21782024-09-23T23:17:27.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21792024-09-23T23:17:27.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21802024-09-23T23:17:27.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21812024-09-23T23:17:27.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21822024-09-23T23:17:27.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21832024-09-23T23:17:27.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21842024-09-23T23:17:27.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21852024-09-23T23:17:27.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21862024-09-23T23:17:27.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21872024-09-23T23:17:27.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.096422ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21882024-09-23T23:17:27.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21892024-09-23T23:17:27.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
21902024-09-23T23:17:27.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21912024-09-23T23:17:27.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21922024-09-23T23:17:27.844ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
21932024-09-23T23:17:27.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.5372ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
21942024-09-23T23:17:28.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a17bd5f3-e9be-4839-af6c-3f5be26b4892 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21952024-09-23T23:17:28.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a17bd5f3-e9be-4839-af6c-3f5be26b4892 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21962024-09-23T23:17:28.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a17bd5f3-e9be-4839-af6c-3f5be26b4892 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21972024-09-23T23:17:29.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bac262e7-2695-4c82-8f53-6aeb7af10085 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21982024-09-23T23:17:29.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bac262e7-2695-4c82-8f53-6aeb7af10085 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
21992024-09-23T23:17:29.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bac262e7-2695-4c82-8f53-6aeb7af10085 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22002024-09-23T23:17:30.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 60e667f8-aa4f-4558-a1e2-13f9b3e0a9b8 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22012024-09-23T23:17:30.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 60e667f8-aa4f-4558-a1e2-13f9b3e0a9b8 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22022024-09-23T23:17:30.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 60e667f8-aa4f-4558-a1e2-13f9b3e0a9b8 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22032024-09-23T23:17:31.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 13d98127-66be-424d-ae05-222c0e40ca9b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22042024-09-23T23:17:31.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 13d98127-66be-424d-ae05-222c0e40ca9b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22052024-09-23T23:17:31.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 13d98127-66be-424d-ae05-222c0e40ca9b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22062024-09-23T23:17:32.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4ccef145-b5c0-4ba5-bb67-00a5985983c9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22072024-09-23T23:17:32.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4ccef145-b5c0-4ba5-bb67-00a5985983c9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22082024-09-23T23:17:32.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4ccef145-b5c0-4ba5-bb67-00a5985983c9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22092024-09-23T23:17:33.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 33dd15e1-1213-4edf-9257-5a61a3e54f66 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22102024-09-23T23:17:33.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 33dd15e1-1213-4edf-9257-5a61a3e54f66 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22112024-09-23T23:17:33.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 33dd15e1-1213-4edf-9257-5a61a3e54f66 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22122024-09-23T23:17:34.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 97012560-3d50-4956-a78f-d7807d46b0c0 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22132024-09-23T23:17:34.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 97012560-3d50-4956-a78f-d7807d46b0c0 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22142024-09-23T23:17:34.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 97012560-3d50-4956-a78f-d7807d46b0c0 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22152024-09-23T23:17:35.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e238d6f3-9ab3-4bd5-bb48-17c51d441ec7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22162024-09-23T23:17:35.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e238d6f3-9ab3-4bd5-bb48-17c51d441ec7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22172024-09-23T23:17:35.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e238d6f3-9ab3-4bd5-bb48-17c51d441ec7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22182024-09-23T23:17:36.069ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1416 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 933e1874-df5d-49d8-a0f8-d7ee3ef65fc8 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
22192024-09-23T23:17:36.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 02a1608e-2afc-426b-afa1-3ec8ee95e910 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22202024-09-23T23:17:36.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 02a1608e-2afc-426b-afa1-3ec8ee95e910 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22212024-09-23T23:17:36.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 02a1608e-2afc-426b-afa1-3ec8ee95e910 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22222024-09-23T23:17:37.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 70e5e56a-3090-4040-b857-2f4c9387796d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22232024-09-23T23:17:37.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 70e5e56a-3090-4040-b857-2f4c9387796d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22242024-09-23T23:17:37.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 70e5e56a-3090-4040-b857-2f4c9387796d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
22252024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
22262024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
22272024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22282024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
22292024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22302024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
22312024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
22322024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22332024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22342024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
22352024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22362024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
22372024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
22382024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
22392024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22402024-09-23T23:17:37.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-23 23:07:37.801810981 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22412024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22422024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22432024-09-23T23:17:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
22442024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22452024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22462024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22472024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22482024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22492024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22502024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
22512024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
22522024-09-23T23:17:37.802ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82
22532024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22542024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
22552024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.77\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82"}
22562024-09-23T23:17:37.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("954a3d10-a2dd-433b-9252-ede695863bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 688026941 } })
22572024-09-23T23:17:37.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65799211-2178-4ef6-a14b-629ea048347e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2729181-3180-4ecf-bd42-a48f1144b71d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 688040281 } })
22582024-09-23T23:17:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22592024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22602024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
22612024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22622024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22632024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
22642024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
22652024-09-23T23:17:37.804ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
22662024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22672024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22682024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
22692024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
22702024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22712024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22722024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22732024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
22742024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22752024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
22762024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22772024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
22782024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22792024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
22802024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22812024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
22822024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22832024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
22842024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22852024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
22862024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22872024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
22882024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22892024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
22902024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22912024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
22922024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22932024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
22942024-09-23T23:17:37.804ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22952024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22962024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22972024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.142126ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22982024-09-23T23:17:37.804ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
22992024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.120216ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
23002024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23012024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23022024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23032024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23042024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23052024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23062024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23072024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23082024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23092024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23102024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23112024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23122024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23132024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23142024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23152024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23162024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23172024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23182024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23192024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
23202024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
23212024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23222024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23232024-09-23T23:17:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23242024-09-23T23:17:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23252024-09-23T23:17:37.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 691806694 } })
23262024-09-23T23:17:37.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23272024-09-23T23:17:37.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23282024-09-23T23:17:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23292024-09-23T23:17:37.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
23302024-09-23T23:17:37.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 693202510 } })
23312024-09-23T23:17:37.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
23322024-09-23T23:17:37.808ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-23 23:07:37.801810981 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23332024-09-23T23:17:37.808ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.739267ms iteration = 6 status = {"expiration":"2024-09-23T23:07:37.801810981Z","pruned":[]}
23342024-09-23T23:17:37.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23352024-09-23T23:17:37.811ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.071635ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23362024-09-23T23:17:37.811ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23372024-09-23T23:17:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23382024-09-23T23:17:37.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23392024-09-23T23:17:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23402024-09-23T23:17:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23412024-09-23T23:17:37.815ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.468841ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
23422024-09-23T23:17:37.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23432024-09-23T23:17:37.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23442024-09-23T23:17:37.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23452024-09-23T23:17:37.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23462024-09-23T23:17:37.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23472024-09-23T23:17:37.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23482024-09-23T23:17:37.827ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23492024-09-23T23:17:37.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23502024-09-23T23:17:37.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23512024-09-23T23:17:37.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23522024-09-23T23:17:37.845ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23532024-09-23T23:17:37.845ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23542024-09-23T23:17:37.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23552024-09-23T23:17:37.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23562024-09-23T23:17:37.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23572024-09-23T23:17:37.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23582024-09-23T23:17:37.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23592024-09-23T23:17:37.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23602024-09-23T23:17:37.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23612024-09-23T23:17:37.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.051747ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
23622024-09-23T23:17:37.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23632024-09-23T23:17:37.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23642024-09-23T23:17:37.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23652024-09-23T23:17:37.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23662024-09-23T23:17:37.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23672024-09-23T23:17:37.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23682024-09-23T23:17:37.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23692024-09-23T23:17:37.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23702024-09-23T23:17:37.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23712024-09-23T23:17:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23722024-09-23T23:17:37.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23732024-09-23T23:17:37.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23742024-09-23T23:17:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23752024-09-23T23:17:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23762024-09-23T23:17:37.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23772024-09-23T23:17:37.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782024-09-23T23:17:37.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
23792024-09-23T23:17:37.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23802024-09-23T23:17:37.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23812024-09-23T23:17:37.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23822024-09-23T23:17:37.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23832024-09-23T23:17:37.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23842024-09-23T23:17:37.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23852024-09-23T23:17:37.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23862024-09-23T23:17:37.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23872024-09-23T23:17:37.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23882024-09-23T23:17:37.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23892024-09-23T23:17:37.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.715247ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23902024-09-23T23:17:37.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912024-09-23T23:17:37.865ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23922024-09-23T23:17:37.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23932024-09-23T23:17:37.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23942024-09-23T23:17:37.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23952024-09-23T23:17:37.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23962024-09-23T23:17:37.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.909184ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
23972024-09-23T23:17:37.867ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23982024-09-23T23:17:37.867ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23992024-09-23T23:17:37.867ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.008446ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24002024-09-23T23:17:37.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24012024-09-23T23:17:37.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24022024-09-23T23:17:37.868ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24032024-09-23T23:17:37.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24042024-09-23T23:17:37.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24052024-09-23T23:17:37.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24062024-09-23T23:17:37.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24072024-09-23T23:17:37.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24082024-09-23T23:17:37.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24092024-09-23T23:17:37.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24102024-09-23T23:17:37.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24112024-09-23T23:17:37.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24122024-09-23T23:17:37.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 757392930 } })
24132024-09-23T23:17:37.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24142024-09-23T23:17:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24152024-09-23T23:17:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24162024-09-23T23:17:37.873ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
24172024-09-23T23:17:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24182024-09-23T23:17:37.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24192024-09-23T23:17:37.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24202024-09-23T23:17:37.884ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
24212024-09-23T23:17:37.884ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.021805ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
24222024-09-23T23:17:37.902ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24232024-09-23T23:17:37.902ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24242024-09-23T23:17:37.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24252024-09-23T23:17:37.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24262024-09-23T23:17:37.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24272024-09-23T23:17:37.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24282024-09-23T23:17:37.908ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
24292024-09-23T23:17:37.908ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 103.694325ms iteration = 6 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
24302024-09-23T23:17:37.913ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24312024-09-23T23:17:37.913ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24322024-09-23T23:17:37.913ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24332024-09-23T23:17:37.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24342024-09-23T23:17:37.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24352024-09-23T23:17:37.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24362024-09-23T23:17:37.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24372024-09-23T23:17:37.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.310155ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
24382024-09-23T23:17:37.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24392024-09-23T23:17:37.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24402024-09-23T23:17:37.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24412024-09-23T23:17:37.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24422024-09-23T23:17:37.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24432024-09-23T23:17:37.921ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24442024-09-23T23:17:37.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24452024-09-23T23:17:37.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
24462024-09-23T23:17:37.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24472024-09-23T23:17:37.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24482024-09-23T23:17:37.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24492024-09-23T23:17:37.926ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.558931ms iteration = 11 status = 0
24502024-09-23T23:17:37.926ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
24512024-09-23T23:17:37.927ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
24522024-09-23T23:17:37.927ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.133327ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
24532024-09-23T23:17:37.928ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24542024-09-23T23:17:37.928ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 123.788607ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24552024-09-23T23:17:37.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 124.436714ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
24562024-09-23T23:17:37.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24572024-09-23T23:17:37.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24582024-09-23T23:17:37.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24592024-09-23T23:17:37.931ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24602024-09-23T23:17:37.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24612024-09-23T23:17:37.933ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24622024-09-23T23:17:37.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24632024-09-23T23:17:37.935ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24642024-09-23T23:17:37.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24652024-09-23T23:17:37.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24662024-09-23T23:17:37.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24672024-09-23T23:17:37.942ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24682024-09-23T23:17:37.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24692024-09-23T23:17:37.945ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24702024-09-23T23:17:37.955ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24712024-09-23T23:17:37.955ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24722024-09-23T23:17:37.955ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24732024-09-23T23:17:37.955ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.692837ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24742024-09-23T23:17:37.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
24752024-09-23T23:17:37.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
24762024-09-23T23:17:37.956ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24772024-09-23T23:17:37.956ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24782024-09-23T23:17:37.959ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fd5f2a92-73eb-4eb2-9c6a-42d04f20d100", "content-length": "26", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
24792024-09-23T23:17:37.959ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24802024-09-23T23:17:37.959ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5d72fe5b-bf4f-4f7e-b143-d3c7fdb9a97e", "content-length": "26", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
24812024-09-23T23:17:37.959ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24822024-09-23T23:17:37.961ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24832024-09-23T23:17:37.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24842024-09-23T23:17:37.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24852024-09-23T23:17:37.963ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24862024-09-23T23:17:37.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24872024-09-23T23:17:37.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24882024-09-23T23:17:37.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24892024-09-23T23:17:37.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24902024-09-23T23:17:37.979ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24912024-09-23T23:17:37.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 175.331071ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
24922024-09-23T23:17:37.982ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24932024-09-23T23:17:37.982ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24942024-09-23T23:17:37.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24952024-09-23T23:17:38.009ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 205.200195ms iteration = 14 status = {"physical_disks_added":0}
24962024-09-23T23:17:38.046ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24972024-09-23T23:17:38.046ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24982024-09-23T23:17:38.046ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24992024-09-23T23:17:38.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25002024-09-23T23:17:38.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25012024-09-23T23:17:38.047ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
25022024-09-23T23:17:38.047ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25032024-09-23T23:17:38.047ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c5c562b4-f31b-443e-b836-760ccb8382f2", "content-length": "26", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
25042024-09-23T23:17:38.047ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25052024-09-23T23:17:38.048ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
25062024-09-23T23:17:38.093ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25072024-09-23T23:17:38.093ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "650676e3-bac5-4cc0-8406-4b1b0d22a137", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25082024-09-23T23:17:38.093ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25092024-09-23T23:17:38.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9c05d06e-0ca7-4725-b5f5-2dd92fbddf28", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25102024-09-23T23:17:38.095ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25112024-09-23T23:17:38.096ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25122024-09-23T23:17:38.096ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 295.134901ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25132024-09-23T23:17:38.109ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25142024-09-23T23:17:38.110ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bf3dcfd5-1a70-46fa-b154-abab5113330e", "content-length": "1", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
25152024-09-23T23:17:38.112ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25162024-09-23T23:17:38.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25172024-09-23T23:17:38.124ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25182024-09-23T23:17:38.125ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "819b0648-94ca-4757-ad7f-d0fee3191b64", "content-length": "372", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
25192024-09-23T23:17:38.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25202024-09-23T23:17:38.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25212024-09-23T23:17:38.126ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25222024-09-23T23:17:38.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25232024-09-23T23:17:38.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25242024-09-23T23:17:38.129ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 328.02516ms iteration = 11 status = null
25252024-09-23T23:17:38.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25262024-09-23T23:17:38.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25272024-09-23T23:17:38.131ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25282024-09-23T23:17:38.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25292024-09-23T23:17:38.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25302024-09-23T23:17:38.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25312024-09-23T23:17:38.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25322024-09-23T23:17:38.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25332024-09-23T23:17:38.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25342024-09-23T23:17:38.134ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25352024-09-23T23:17:38.134ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25362024-09-23T23:17:38.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25372024-09-23T23:17:38.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25382024-09-23T23:17:38.135ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25392024-09-23T23:17:38.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25402024-09-23T23:17:38.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25412024-09-23T23:17:38.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25422024-09-23T23:17:38.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25432024-09-23T23:17:38.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25442024-09-23T23:17:38.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25452024-09-23T23:17:38.139ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25462024-09-23T23:17:38.139ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e9a3c8c9-5d5b-412e-bc67-0f6634635e7b", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
25472024-09-23T23:17:38.141ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 336.574038ms iteration = 12 status = {}
25482024-09-23T23:17:38.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25492024-09-23T23:17:38.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25502024-09-23T23:17:38.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25512024-09-23T23:17:38.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25522024-09-23T23:17:38.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25532024-09-23T23:17:38.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25542024-09-23T23:17:38.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25552024-09-23T23:17:38.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25562024-09-23T23:17:38.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25572024-09-23T23:17:38.154ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25582024-09-23T23:17:38.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25592024-09-23T23:17:38.156ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25602024-09-23T23:17:38.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25612024-09-23T23:17:38.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25622024-09-23T23:17:38.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25632024-09-23T23:17:38.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25642024-09-23T23:17:38.163ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25652024-09-23T23:17:38.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25662024-09-23T23:17:38.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25672024-09-23T23:17:38.164ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-23T23:12:36.221760Z, time_modified: 2024-09-23T23:12:36.221760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }) }
25682024-09-23T23:17:38.164ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 362.539907ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]}},"default_endpoint":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25692024-09-23T23:17:38.165ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25702024-09-23T23:17:38.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25712024-09-23T23:17:38.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25722024-09-23T23:17:38.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25732024-09-23T23:17:38.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25742024-09-23T23:17:38.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25752024-09-23T23:17:38.168ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25762024-09-23T23:17:38.168ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 0 version = 2
25772024-09-23T23:17:38.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25782024-09-23T23:17:38.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25792024-09-23T23:17:38.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25802024-09-23T23:17:38.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25812024-09-23T23:17:38.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25822024-09-23T23:17:38.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25832024-09-23T23:17:38.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25842024-09-23T23:17:38.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25852024-09-23T23:17:38.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25862024-09-23T23:17:38.173ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25872024-09-23T23:17:38.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25882024-09-23T23:17:38.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25892024-09-23T23:17:38.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25902024-09-23T23:17:38.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25912024-09-23T23:17:38.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25922024-09-23T23:17:38.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25932024-09-23T23:17:38.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25942024-09-23T23:17:38.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25952024-09-23T23:17:38.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25962024-09-23T23:17:38.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25972024-09-23T23:17:38.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25982024-09-23T23:17:38.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25992024-09-23T23:17:38.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26002024-09-23T23:17:38.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26012024-09-23T23:17:38.178ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 1 version = 2
26022024-09-23T23:17:38.179ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26032024-09-23T23:17:38.179ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-23 23:12:40.294485 UTC dns_group = external generation = 2
26042024-09-23T23:17:38.179ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 377.310148ms iteration = 7 status = {"generation":2}
26052024-09-23T23:17:38.180ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
26062024-09-23T23:17:38.180ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26072024-09-23T23:17:38.180ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-23 23:12:39.428682 UTC dns_group = internal generation = 1
26082024-09-23T23:17:38.180ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 378.249359ms iteration = 7 status = {"generation":1}
26092024-09-23T23:17:38.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26102024-09-23T23:17:38.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26112024-09-23T23:17:38.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26122024-09-23T23:17:38.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26132024-09-23T23:17:38.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26142024-09-23T23:17:38.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26152024-09-23T23:17:38.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26162024-09-23T23:17:38.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26172024-09-23T23:17:38.187ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26182024-09-23T23:17:38.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26192024-09-23T23:17:38.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26202024-09-23T23:17:38.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26212024-09-23T23:17:38.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26222024-09-23T23:17:38.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
26232024-09-23T23:17:38.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26242024-09-23T23:17:38.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26252024-09-23T23:17:38.197ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26262024-09-23T23:17:38.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26272024-09-23T23:17:38.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26282024-09-23T23:17:38.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26292024-09-23T23:17:38.199ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26302024-09-23T23:17:38.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
26312024-09-23T23:17:38.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26322024-09-23T23:17:38.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26332024-09-23T23:17:38.210ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
26342024-09-23T23:17:38.210ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26352024-09-23T23:17:38.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26362024-09-23T23:17:38.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26372024-09-23T23:17:38.212ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26382024-09-23T23:17:38.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
26392024-09-23T23:17:38.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26402024-09-23T23:17:38.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26412024-09-23T23:17:38.215ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 413.469995ms iteration = 11 status = {}
26422024-09-23T23:17:38.218ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
26432024-09-23T23:17:38.218ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 074197bc-2b3f-4fe9-94c0-14608c5dfec9, kind: Service { id: 954a3d10-a2dd-433b-9252-ede695863bda }, name: Name("external-dns-954a3d10-a2dd-433b-9252-ede695863bda"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a3ab2617-5a99-4fbe-a7d1-4d5673064c67, kind: Service { id: e3d8dede-8980-4764-ac40-c508c2ebab6c }, name: Name("external-dns-e3d8dede-8980-4764-ac40-c508c2ebab6c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 212])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 12e743bf-60f7-4d25-9b2b-595ff259882d, kind: Service { id: 8edf7e0a-db5e-4594-b36b-7d389db56474 }, name: Name("nexus-8edf7e0a-db5e-4594-b36b-7d389db56474"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 27])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ad747b06-b112-4f84-a56c-95e2ad7cc8d4, kind: Service { id: 212442ce-6712-4c6a-beb4-26917e04679b }, name: Name("nexus-212442ce-6712-4c6a-beb4-26917e04679b"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ebf272b6-074a-4cee-a95e-216e4da4a83b, kind: Service { id: b905b025-1e4a-4a11-bf0c-620257156cd8 }, name: Name("nexus-b905b025-1e4a-4a11-bf0c-620257156cd8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
26442024-09-23T23:17:38.218ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
26452024-09-23T23:17:38.277ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26462024-09-23T23:17:38.277ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "346fcdd6-7466-499b-90f2-2b49b684e220", "date": "Mon, 23 Sep 2024 23:17:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26472024-09-23T23:17:38.277ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26482024-09-23T23:17:38.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0e7ecbeb-78f8-4d24-abd8-dc0204a115f3", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26492024-09-23T23:17:38.280ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26502024-09-23T23:17:38.282ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2e4f209e-6e43-4562-a701-de540c279053", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26512024-09-23T23:17:38.282ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26522024-09-23T23:17:38.284ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
26532024-09-23T23:17:38.284ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 483.272619ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26542024-09-23T23:17:38.302ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26552024-09-23T23:17:38.304ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b6022833-4d34-4cae-b11d-80d3db8776a4", "content-length": "691", "date": "Mon, 23 Sep 2024 23:17:38 GMT"} })
26562024-09-23T23:17:38.304ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26572024-09-23T23:17:38.304ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26582024-09-23T23:17:38.304ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26592024-09-23T23:17:38.305ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 501.000924ms iteration = 11 status = {}
26602024-09-23T23:17:38.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26612024-09-23T23:17:38.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26622024-09-23T23:17:38.317ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
26632024-09-23T23:17:38.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26642024-09-23T23:17:38.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26652024-09-23T23:17:38.327ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26662024-09-23T23:17:38.328ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a670343f-6d0b-4661-8955-1558eae7146a", "content-length": "121", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
26672024-09-23T23:17:38.328ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
26682024-09-23T23:17:38.328ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
26692024-09-23T23:17:38.328ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26702024-09-23T23:17:38.328ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26712024-09-23T23:17:38.328ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
26722024-09-23T23:17:38.328ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
26732024-09-23T23:17:38.328ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
26742024-09-23T23:17:38.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26752024-09-23T23:17:38.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26762024-09-23T23:17:38.331ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26772024-09-23T23:17:38.331ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "27f45daf-beae-4f29-885f-c1589b93625f", "content-length": "2", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
26782024-09-23T23:17:38.331ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26792024-09-23T23:17:38.331ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9402502f-d6e4-4191-8d91-9c3cf449a6c4", "content-length": "52", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
26802024-09-23T23:17:38.331ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
26812024-09-23T23:17:38.331ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26822024-09-23T23:17:38.360ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: a6cfeab5-1bcd-4180-8b80-d27bd607042d, time_created: 2024-09-23T23:12:39.120161Z, time_modified: 2024-09-23T23:12:39.120161Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
26832024-09-23T23:17:38.360ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
26842024-09-23T23:17:38.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26852024-09-23T23:17:38.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26862024-09-23T23:17:38.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26872024-09-23T23:17:38.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26882024-09-23T23:17:38.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26892024-09-23T23:17:38.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
26902024-09-23T23:17:38.405ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26912024-09-23T23:17:38.437ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c7161922-4c10-4c88-8c87-aa434bf4d1e3", "date": "Mon, 23 Sep 2024 23:17:38 GMT"} })
26922024-09-23T23:17:38.437ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
26932024-09-23T23:17:38.437ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26942024-09-23T23:17:38.437ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "22c5f676-9ef8-4451-aab4-d8c5ebd483b8", "date": "Mon, 23 Sep 2024 23:17:38 GMT"} })
26952024-09-23T23:17:38.439ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
26962024-09-23T23:17:38.439ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 635.255571ms
26972024-09-23T23:17:38.439ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 635.264301ms iteration = 2 status = {}
26982024-09-23T23:17:38.439ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fe32b1fc-1119-424a-95bb-f720c91f0ddc", "content-length": "667", "date": "Mon, 23 Sep 2024 23:17:37 GMT"} })
26992024-09-23T23:17:38.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27002024-09-23T23:17:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27012024-09-23T23:17:38.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27022024-09-23T23:17:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27032024-09-23T23:17:38.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27042024-09-23T23:17:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27052024-09-23T23:17:38.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27062024-09-23T23:17:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27072024-09-23T23:17:38.456ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 651.796392ms iteration = 11 status = {}
27082024-09-23T23:17:38.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = cfa9675a-3ba1-41be-83db-055ddf248468 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
27092024-09-23T23:17:38.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = cfa9675a-3ba1-41be-83db-055ddf248468 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
27102024-09-23T23:17:38.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = cfa9675a-3ba1-41be-83db-055ddf248468 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
27112024-09-23T23:17:38.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0adf3b55-d9f6-4121-91aa-387a0be1d33f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27122024-09-23T23:17:38.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0adf3b55-d9f6-4121-91aa-387a0be1d33f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27132024-09-23T23:17:38.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0adf3b55-d9f6-4121-91aa-387a0be1d33f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27142024-09-23T23:17:39.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f07980ce-5e2d-4486-a959-2dfc4f79e349 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27152024-09-23T23:17:39.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f07980ce-5e2d-4486-a959-2dfc4f79e349 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27162024-09-23T23:17:39.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f07980ce-5e2d-4486-a959-2dfc4f79e349 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27172024-09-23T23:17:40.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 51836830-f4c5-48c4-919f-b950139386a5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27182024-09-23T23:17:40.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 51836830-f4c5-48c4-919f-b950139386a5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27192024-09-23T23:17:40.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 51836830-f4c5-48c4-919f-b950139386a5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27202024-09-23T23:17:41.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9ca587c9-9627-4d04-9f10-16eaf614cb0e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27212024-09-23T23:17:41.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9ca587c9-9627-4d04-9f10-16eaf614cb0e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27222024-09-23T23:17:41.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9ca587c9-9627-4d04-9f10-16eaf614cb0e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27232024-09-23T23:17:42.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2008d435-be64-4298-a40d-e2edf17fed26 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27242024-09-23T23:17:42.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2008d435-be64-4298-a40d-e2edf17fed26 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27252024-09-23T23:17:42.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2008d435-be64-4298-a40d-e2edf17fed26 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27262024-09-23T23:17:43.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eaad57b5-3cb6-46ee-93e9-5851c0505340 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27272024-09-23T23:17:43.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eaad57b5-3cb6-46ee-93e9-5851c0505340 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27282024-09-23T23:17:43.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eaad57b5-3cb6-46ee-93e9-5851c0505340 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27292024-09-23T23:17:44.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3bd95a6c-2bc9-4e95-837c-0eb13159b004 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27302024-09-23T23:17:44.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3bd95a6c-2bc9-4e95-837c-0eb13159b004 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27312024-09-23T23:17:44.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3bd95a6c-2bc9-4e95-837c-0eb13159b004 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27322024-09-23T23:17:45.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a5f8bd6-fed7-4499-9fa8-3a047a293833 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27332024-09-23T23:17:45.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a5f8bd6-fed7-4499-9fa8-3a047a293833 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27342024-09-23T23:17:45.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a5f8bd6-fed7-4499-9fa8-3a047a293833 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27352024-09-23T23:17:46.069ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = b97c1798-7b02-4a87-a450-0cd94871bf46 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
27362024-09-23T23:17:46.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c25023d8-5660-40ad-8d47-f53e7a54a777 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27372024-09-23T23:17:46.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c25023d8-5660-40ad-8d47-f53e7a54a777 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27382024-09-23T23:17:46.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c25023d8-5660-40ad-8d47-f53e7a54a777 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27392024-09-23T23:17:47.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
27402024-09-23T23:17:47.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27412024-09-23T23:17:47.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27422024-09-23T23:17:47.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
27432024-09-23T23:17:47.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27442024-09-23T23:17:47.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27452024-09-23T23:17:47.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27462024-09-23T23:17:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27472024-09-23T23:17:47.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27482024-09-23T23:17:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27492024-09-23T23:17:47.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27502024-09-23T23:17:47.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27512024-09-23T23:17:47.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27522024-09-23T23:17:47.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
27532024-09-23T23:17:47.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27542024-09-23T23:17:47.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27552024-09-23T23:17:47.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
27562024-09-23T23:17:47.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.898848ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
27572024-09-23T23:17:47.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27582024-09-23T23:17:47.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27592024-09-23T23:17:47.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.316653ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27602024-09-23T23:17:47.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9792623a-e10e-4587-80e7-78db85163cd3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27612024-09-23T23:17:47.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9792623a-e10e-4587-80e7-78db85163cd3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27622024-09-23T23:17:47.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9792623a-e10e-4587-80e7-78db85163cd3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27632024-09-23T23:17:48.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 493155be-f8f4-4191-86c4-844a62a7a551 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27642024-09-23T23:17:48.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 493155be-f8f4-4191-86c4-844a62a7a551 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27652024-09-23T23:17:48.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 493155be-f8f4-4191-86c4-844a62a7a551 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27662024-09-23T23:17:49.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2c6b59b3-9986-4d21-9d75-bf9fd748ef0c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27672024-09-23T23:17:49.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2c6b59b3-9986-4d21-9d75-bf9fd748ef0c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27682024-09-23T23:17:49.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2c6b59b3-9986-4d21-9d75-bf9fd748ef0c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27692024-09-23T23:17:50.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9d3630bc-ad5c-4c6e-ac71-cbd012799f77 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27702024-09-23T23:17:50.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9d3630bc-ad5c-4c6e-ac71-cbd012799f77 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27712024-09-23T23:17:50.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9d3630bc-ad5c-4c6e-ac71-cbd012799f77 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27722024-09-23T23:17:51.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fffdf144-cf08-4804-9574-e242bf78fb0b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27732024-09-23T23:17:51.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fffdf144-cf08-4804-9574-e242bf78fb0b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27742024-09-23T23:17:51.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fffdf144-cf08-4804-9574-e242bf78fb0b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27752024-09-23T23:17:52.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e43ebaa0-1f68-4cea-84de-18055324aa58 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27762024-09-23T23:17:52.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e43ebaa0-1f68-4cea-84de-18055324aa58 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27772024-09-23T23:17:52.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e43ebaa0-1f68-4cea-84de-18055324aa58 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27782024-09-23T23:17:54.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bb30ab2f-ec78-4968-8d29-966a3ef4aff2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27792024-09-23T23:17:54.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bb30ab2f-ec78-4968-8d29-966a3ef4aff2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27802024-09-23T23:17:54.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bb30ab2f-ec78-4968-8d29-966a3ef4aff2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27812024-09-23T23:17:55.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5d2f7cac-cdb7-423d-9839-64b23683d9db roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27822024-09-23T23:17:55.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5d2f7cac-cdb7-423d-9839-64b23683d9db resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27832024-09-23T23:17:55.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5d2f7cac-cdb7-423d-9839-64b23683d9db response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27842024-09-23T23:17:56.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 44312ce4-3b32-42ff-b6a0-8f716f6e9d4d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27852024-09-23T23:17:56.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 44312ce4-3b32-42ff-b6a0-8f716f6e9d4d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27862024-09-23T23:17:56.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 44312ce4-3b32-42ff-b6a0-8f716f6e9d4d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
27872024-09-23T23:17:56.069ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1360 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 9b0df987-5b70-425f-8547-63b802851bb0 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
27882024-09-23T23:17:56.069ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
27892024-09-23T23:17:56.069ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
27902024-09-23T23:17:56.099ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
27912024-09-23T23:17:56.099ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36949
27922024-09-23T23:17:56.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36949 req_id = 002287e9-785c-4996-9dfb-b80a2911ffdc roles = RoleSet { roles: {} } uri = /metrics/producers
27932024-09-23T23:17:56.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36949 req_id = 002287e9-785c-4996-9dfb-b80a2911ffdc resource = Database result = Ok(()) uri = /metrics/producers
27942024-09-23T23:17:56.132ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
27952024-09-23T23:17:56.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36949 req_id = 002287e9-785c-4996-9dfb-b80a2911ffdc roles = RoleSet { roles: {} } uri = /metrics/producers
27962024-09-23T23:17:56.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36949 req_id = 002287e9-785c-4996-9dfb-b80a2911ffdc resource = Database result = Ok(()) uri = /metrics/producers
27972024-09-23T23:17:56.176ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
27982024-09-23T23:17:56.176ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2f23cc5f-5598-4fa7-b39d-03045cd41169", "date": "Mon, 23 Sep 2024 23:17:56 GMT"} })
27992024-09-23T23:17:56.176ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = 212442ce-6712-4c6a-beb4-26917e04679b
28002024-09-23T23:17:56.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 78222 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36949 req_id = 002287e9-785c-4996-9dfb-b80a2911ffdc response_code = 201 uri = /metrics/producers
28012024-09-23T23:17:56.177ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "002287e9-785c-4996-9dfb-b80a2911ffdc", "content-length": "41", "date": "Mon, 23 Sep 2024 23:17:56 GMT"} })
28022024-09-23T23:17:56.179ZDEBGnexus (producer-registration-task): registered with nexus successfully
28032024-09-23T23:17:56.179ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
28042024-09-23T23:17:57.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2cd6bcb5-d59e-4bca-b4d2-ef1a700fdbfd roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28052024-09-23T23:17:57.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2cd6bcb5-d59e-4bca-b4d2-ef1a700fdbfd resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28062024-09-23T23:17:57.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2cd6bcb5-d59e-4bca-b4d2-ef1a700fdbfd response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28072024-09-23T23:17:57.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
28082024-09-23T23:17:57.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28092024-09-23T23:17:57.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28102024-09-23T23:17:57.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28112024-09-23T23:17:57.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
28122024-09-23T23:17:57.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28132024-09-23T23:17:57.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28142024-09-23T23:17:57.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28152024-09-23T23:17:57.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28162024-09-23T23:17:57.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28172024-09-23T23:17:57.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28182024-09-23T23:17:57.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28192024-09-23T23:17:57.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28202024-09-23T23:17:57.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
28212024-09-23T23:17:57.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28222024-09-23T23:17:57.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28232024-09-23T23:17:57.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
28242024-09-23T23:17:57.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.898198ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
28252024-09-23T23:17:57.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28262024-09-23T23:17:57.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28272024-09-23T23:17:57.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.134586ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28282024-09-23T23:17:58.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e250a5a2-9099-4cc6-9de6-6b5b5e717c86 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28292024-09-23T23:17:58.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e250a5a2-9099-4cc6-9de6-6b5b5e717c86 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28302024-09-23T23:17:58.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1898 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e250a5a2-9099-4cc6-9de6-6b5b5e717c86 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28312024-09-23T23:17:59.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fe3270b0-ec51-4734-b70b-cd83758ba905 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28322024-09-23T23:17:59.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fe3270b0-ec51-4734-b70b-cd83758ba905 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28332024-09-23T23:17:59.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fe3270b0-ec51-4734-b70b-cd83758ba905 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28342024-09-23T23:18:00.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 18749efb-8781-4f54-b8d1-7f08875fa5ad roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28352024-09-23T23:18:00.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 18749efb-8781-4f54-b8d1-7f08875fa5ad resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28362024-09-23T23:18:00.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 18749efb-8781-4f54-b8d1-7f08875fa5ad response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28372024-09-23T23:18:01.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1eb7f7d6-222e-4991-9275-c01cc9c724e7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28382024-09-23T23:18:01.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1eb7f7d6-222e-4991-9275-c01cc9c724e7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28392024-09-23T23:18:01.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1eb7f7d6-222e-4991-9275-c01cc9c724e7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28402024-09-23T23:18:02.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1570dbf8-6cf0-4118-b6c9-f34448fac60a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28412024-09-23T23:18:02.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1570dbf8-6cf0-4118-b6c9-f34448fac60a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28422024-09-23T23:18:02.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1570dbf8-6cf0-4118-b6c9-f34448fac60a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28432024-09-23T23:18:03.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 250ead75-3356-4f9e-a235-f26bc5ef6dcc roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28442024-09-23T23:18:03.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 250ead75-3356-4f9e-a235-f26bc5ef6dcc resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28452024-09-23T23:18:03.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 250ead75-3356-4f9e-a235-f26bc5ef6dcc response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28462024-09-23T23:18:04.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f551909a-63c3-49eb-be83-09299854ecee roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28472024-09-23T23:18:04.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f551909a-63c3-49eb-be83-09299854ecee resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28482024-09-23T23:18:04.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f551909a-63c3-49eb-be83-09299854ecee response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28492024-09-23T23:18:05.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c8693c50-960c-4759-a387-f0c4285b57c3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28502024-09-23T23:18:05.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c8693c50-960c-4759-a387-f0c4285b57c3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28512024-09-23T23:18:05.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c8693c50-960c-4759-a387-f0c4285b57c3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28522024-09-23T23:18:06.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1730 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 436d20e9-9742-4724-9b9c-68ee6ca078a5 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
28532024-09-23T23:18:06.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e7af51c2-828e-4716-9bf6-de86901b79f8 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28542024-09-23T23:18:06.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e7af51c2-828e-4716-9bf6-de86901b79f8 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28552024-09-23T23:18:06.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e7af51c2-828e-4716-9bf6-de86901b79f8 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28562024-09-23T23:18:07.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2627b7b-e4bb-404d-bde7-2e1f0be4fc67 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28572024-09-23T23:18:07.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2627b7b-e4bb-404d-bde7-2e1f0be4fc67 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28582024-09-23T23:18:07.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2627b7b-e4bb-404d-bde7-2e1f0be4fc67 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
28592024-09-23T23:18:07.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
28602024-09-23T23:18:07.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
28612024-09-23T23:18:07.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28622024-09-23T23:18:07.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28632024-09-23T23:18:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28642024-09-23T23:18:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28652024-09-23T23:18:07.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
28662024-09-23T23:18:07.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
28672024-09-23T23:18:07.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28682024-09-23T23:18:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28692024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
28702024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
28712024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28722024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28732024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
28742024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28752024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
28762024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28772024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
28782024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28792024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
28802024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28812024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28822024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
28832024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
28842024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28852024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28862024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
28872024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28882024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
28892024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
28902024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28912024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28922024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
28932024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28942024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
28952024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28962024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28972024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28982024-09-23T23:18:07.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 691941936 } })
28992024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29002024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29012024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29022024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29032024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29042024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29052024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29062024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29072024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29082024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29092024-09-23T23:18:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29102024-09-23T23:18:07.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29112024-09-23T23:18:07.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 693128969 } })
29122024-09-23T23:18:07.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29132024-09-23T23:18:07.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
29142024-09-23T23:18:07.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
29152024-09-23T23:18:07.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.811888ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29162024-09-23T23:18:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29172024-09-23T23:18:07.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29182024-09-23T23:18:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29192024-09-23T23:18:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29202024-09-23T23:18:07.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29212024-09-23T23:18:07.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29222024-09-23T23:18:07.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29232024-09-23T23:18:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29242024-09-23T23:18:07.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29252024-09-23T23:18:07.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29262024-09-23T23:18:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29272024-09-23T23:18:07.816ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29282024-09-23T23:18:07.816ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29292024-09-23T23:18:07.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29302024-09-23T23:18:07.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29312024-09-23T23:18:07.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29322024-09-23T23:18:07.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29332024-09-23T23:18:07.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29342024-09-23T23:18:07.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29352024-09-23T23:18:07.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29362024-09-23T23:18:07.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29372024-09-23T23:18:07.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29382024-09-23T23:18:07.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29392024-09-23T23:18:07.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29402024-09-23T23:18:07.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29412024-09-23T23:18:07.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29422024-09-23T23:18:07.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 715385536 } })
29432024-09-23T23:18:07.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
29442024-09-23T23:18:07.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.385903ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
29452024-09-23T23:18:07.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29462024-09-23T23:18:07.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29472024-09-23T23:18:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29482024-09-23T23:18:07.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.6188ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
29492024-09-23T23:18:07.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502024-09-23T23:18:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29512024-09-23T23:18:07.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29522024-09-23T23:18:07.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29532024-09-23T23:18:07.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29542024-09-23T23:18:07.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29552024-09-23T23:18:07.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29562024-09-23T23:18:07.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.591368ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29572024-09-23T23:18:07.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29582024-09-23T23:18:07.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29592024-09-23T23:18:07.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29602024-09-23T23:18:07.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29612024-09-23T23:18:07.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29622024-09-23T23:18:07.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29632024-09-23T23:18:07.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.508412ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29642024-09-23T23:18:07.862ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29652024-09-23T23:18:07.863ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.658803ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29662024-09-23T23:18:07.864ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
29672024-09-23T23:18:07.864ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29682024-09-23T23:18:07.865ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f920ed71-bd89-40df-b2fb-2965e35a3ace", "content-length": "26", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
29692024-09-23T23:18:07.865ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29702024-09-23T23:18:07.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29712024-09-23T23:18:07.867ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29722024-09-23T23:18:07.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29732024-09-23T23:18:07.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29742024-09-23T23:18:07.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29752024-09-23T23:18:07.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762024-09-23T23:18:07.869ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29772024-09-23T23:18:07.869ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29782024-09-23T23:18:07.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29792024-09-23T23:18:07.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29802024-09-23T23:18:07.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29812024-09-23T23:18:07.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29822024-09-23T23:18:07.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
29832024-09-23T23:18:07.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29842024-09-23T23:18:07.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29852024-09-23T23:18:07.875ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
29862024-09-23T23:18:07.875ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29872024-09-23T23:18:07.875ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6b660afe-7c77-48d7-ac3d-cb21670a5e0d", "content-length": "26", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
29882024-09-23T23:18:07.875ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29892024-09-23T23:18:07.878ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29902024-09-23T23:18:07.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29912024-09-23T23:18:07.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29922024-09-23T23:18:07.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29932024-09-23T23:18:07.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29942024-09-23T23:18:07.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29952024-09-23T23:18:07.884ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
29962024-09-23T23:18:07.884ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.40961ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
29972024-09-23T23:18:07.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29982024-09-23T23:18:07.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29992024-09-23T23:18:07.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30002024-09-23T23:18:07.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30012024-09-23T23:18:07.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.882693ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30022024-09-23T23:18:07.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30032024-09-23T23:18:07.900ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 94.024654ms iteration = 15 status = {"physical_disks_added":0}
30042024-09-23T23:18:07.900ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30052024-09-23T23:18:07.900ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30062024-09-23T23:18:07.900ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 94.289617ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30072024-09-23T23:18:07.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30082024-09-23T23:18:07.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30092024-09-23T23:18:07.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30102024-09-23T23:18:07.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30112024-09-23T23:18:07.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
30122024-09-23T23:18:07.963ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30132024-09-23T23:18:07.964ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "44889848-0a5d-4661-be20-0eeb2866a471", "content-length": "26", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
30142024-09-23T23:18:07.964ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30152024-09-23T23:18:07.966ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
30162024-09-23T23:18:08.008ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30172024-09-23T23:18:08.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30182024-09-23T23:18:08.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30192024-09-23T23:18:08.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30202024-09-23T23:18:08.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30212024-09-23T23:18:08.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30222024-09-23T23:18:08.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
30232024-09-23T23:18:08.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30242024-09-23T23:18:08.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30252024-09-23T23:18:08.023ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 216.740088ms iteration = 12 status = 0
30262024-09-23T23:18:08.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 234.946628ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30272024-09-23T23:18:08.071ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30282024-09-23T23:18:08.071ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2450c0fd-4355-47e2-a467-966042b30cda", "content-length": "1", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
30292024-09-23T23:18:08.072ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30302024-09-23T23:18:08.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30312024-09-23T23:18:08.074ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 272.925995ms iteration = 12 status = null
30322024-09-23T23:18:08.079ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "afcbf30d-c99d-4f2d-8ca5-db24a3478098", "content-length": "372", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
30332024-09-23T23:18:08.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30342024-09-23T23:18:08.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30352024-09-23T23:18:08.082ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 280.418322ms iteration = 12 status = {}
30362024-09-23T23:18:08.139ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30372024-09-23T23:18:08.139ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7ca77218-de0c-44fc-bf7c-72a34af28a41", "content-length": "691", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
30382024-09-23T23:18:08.139ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
30392024-09-23T23:18:08.139ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30402024-09-23T23:18:08.139ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30412024-09-23T23:18:08.139ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 333.693166ms iteration = 12 status = {}
30422024-09-23T23:18:08.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30432024-09-23T23:18:08.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30442024-09-23T23:18:08.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30452024-09-23T23:18:08.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30462024-09-23T23:18:08.148ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30472024-09-23T23:18:08.148ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9f2dc637-b578-486f-b9c7-61e9f6ef2583", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
30482024-09-23T23:18:08.150ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 344.606342ms iteration = 13 status = {}
30492024-09-23T23:18:08.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30502024-09-23T23:18:08.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30512024-09-23T23:18:08.173ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
30522024-09-23T23:18:08.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30532024-09-23T23:18:08.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30542024-09-23T23:18:08.281ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30552024-09-23T23:18:08.281ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2cff9700-0d37-4c7a-a008-d63a6c105865", "content-length": "121", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
30562024-09-23T23:18:08.281ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
30572024-09-23T23:18:08.281ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
30582024-09-23T23:18:08.282ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30592024-09-23T23:18:08.282ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30602024-09-23T23:18:08.282ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
30612024-09-23T23:18:08.282ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
30622024-09-23T23:18:08.282ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
30632024-09-23T23:18:08.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30642024-09-23T23:18:08.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30652024-09-23T23:18:08.284ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30662024-09-23T23:18:08.284ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd97deb2-4192-43dc-9711-0442258d9198", "content-length": "2", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
30672024-09-23T23:18:08.284ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30682024-09-23T23:18:08.284ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b338f81c-4731-45e6-a08e-2e965b3bed19", "content-length": "52", "date": "Mon, 23 Sep 2024 23:18:07 GMT"} })
30692024-09-23T23:18:08.284ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
30702024-09-23T23:18:08.284ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30712024-09-23T23:18:08.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 648acf1c-a82a-48a0-bb25-babc921b30ff roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
30722024-09-23T23:18:08.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 648acf1c-a82a-48a0-bb25-babc921b30ff resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
30732024-09-23T23:18:08.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 648acf1c-a82a-48a0-bb25-babc921b30ff response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
30742024-09-23T23:18:08.384ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d43eaffe-6546-4ca2-bcf5-b215303f1111", "date": "Mon, 23 Sep 2024 23:18:08 GMT"} })
30752024-09-23T23:18:08.384ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
30762024-09-23T23:18:08.384ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30772024-09-23T23:18:08.389ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78bc5e9c-3c7f-4b95-ae72-cbd602812925", "content-length": "667", "date": "Mon, 23 Sep 2024 23:18:08 GMT"} })
30782024-09-23T23:18:08.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30792024-09-23T23:18:08.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30802024-09-23T23:18:08.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30812024-09-23T23:18:08.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30822024-09-23T23:18:08.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30832024-09-23T23:18:08.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30842024-09-23T23:18:08.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30852024-09-23T23:18:08.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30862024-09-23T23:18:08.406ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 600.122507ms iteration = 12 status = {}
30872024-09-23T23:18:08.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = dc2e5616-0b3c-4229-8883-2c9707954c74 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
30882024-09-23T23:18:08.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = dc2e5616-0b3c-4229-8883-2c9707954c74 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
30892024-09-23T23:18:08.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = dc2e5616-0b3c-4229-8883-2c9707954c74 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
30902024-09-23T23:18:09.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0a7ea1d0-1b61-4b41-ac6c-014e598c4c87 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
30912024-09-23T23:18:09.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0a7ea1d0-1b61-4b41-ac6c-014e598c4c87 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
30922024-09-23T23:18:09.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0a7ea1d0-1b61-4b41-ac6c-014e598c4c87 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
30932024-09-23T23:18:09.502ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:54636
30942024-09-23T23:18:09.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54636 req_id = 3b03839b-6975-42ae-952c-95e816716287 roles = RoleSet { roles: {} } uri = /metrics/producers
30952024-09-23T23:18:09.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54636 req_id = 3b03839b-6975-42ae-952c-95e816716287 resource = Database result = Ok(()) uri = /metrics/producers
30962024-09-23T23:18:09.534ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
30972024-09-23T23:18:09.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54636 req_id = 3b03839b-6975-42ae-952c-95e816716287 roles = RoleSet { roles: {} } uri = /metrics/producers
30982024-09-23T23:18:09.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54636 req_id = 3b03839b-6975-42ae-952c-95e816716287 resource = Database result = Ok(()) uri = /metrics/producers
30992024-09-23T23:18:09.566ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
31002024-09-23T23:18:09.567ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "471c0629-7626-4930-b763-91e48a2d943a", "date": "Mon, 23 Sep 2024 23:18:09 GMT"} })
31012024-09-23T23:18:09.567ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = 09b2e92f-0f56-43ff-8e2a-6b0e41405076
31022024-09-23T23:18:09.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65453 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54636 req_id = 3b03839b-6975-42ae-952c-95e816716287 response_code = 201 uri = /metrics/producers
31032024-09-23T23:18:10.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f50e78f3-1f53-4410-9f6c-55582821c897 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31042024-09-23T23:18:10.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f50e78f3-1f53-4410-9f6c-55582821c897 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31052024-09-23T23:18:10.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f50e78f3-1f53-4410-9f6c-55582821c897 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31062024-09-23T23:18:11.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f1b72e99-aeae-4fc9-8390-f30cf2356776 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31072024-09-23T23:18:11.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f1b72e99-aeae-4fc9-8390-f30cf2356776 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31082024-09-23T23:18:11.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f1b72e99-aeae-4fc9-8390-f30cf2356776 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31092024-09-23T23:18:11.477ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:38665
31102024-09-23T23:18:11.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38665 req_id = ba05a91c-1051-4f5d-9017-1a15cd976037 roles = RoleSet { roles: {} } uri = /metrics/producers
31112024-09-23T23:18:11.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38665 req_id = ba05a91c-1051-4f5d-9017-1a15cd976037 resource = Database result = Ok(()) uri = /metrics/producers
31122024-09-23T23:18:11.510ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
31132024-09-23T23:18:11.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38665 req_id = ba05a91c-1051-4f5d-9017-1a15cd976037 roles = RoleSet { roles: {} } uri = /metrics/producers
31142024-09-23T23:18:11.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38665 req_id = ba05a91c-1051-4f5d-9017-1a15cd976037 resource = Database result = Ok(()) uri = /metrics/producers
31152024-09-23T23:18:11.542ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
31162024-09-23T23:18:11.542ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "798fb9aa-f38f-452e-953e-b88ec5adda60", "date": "Mon, 23 Sep 2024 23:18:11 GMT"} })
31172024-09-23T23:18:11.542ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
31182024-09-23T23:18:11.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66771 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38665 req_id = ba05a91c-1051-4f5d-9017-1a15cd976037 response_code = 201 uri = /metrics/producers
31192024-09-23T23:18:12.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f5e94165-bda1-4b2c-9f6f-9f9ad429d75b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31202024-09-23T23:18:12.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f5e94165-bda1-4b2c-9f6f-9f9ad429d75b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31212024-09-23T23:18:12.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f5e94165-bda1-4b2c-9f6f-9f9ad429d75b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31222024-09-23T23:18:13.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9be78ef1-7706-462d-9660-a9805b2bc789 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31232024-09-23T23:18:13.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9be78ef1-7706-462d-9660-a9805b2bc789 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31242024-09-23T23:18:13.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9be78ef1-7706-462d-9660-a9805b2bc789 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31252024-09-23T23:18:14.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5f2681dc-c9c7-4d04-8040-b19c2ddfd5a9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31262024-09-23T23:18:14.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5f2681dc-c9c7-4d04-8040-b19c2ddfd5a9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31272024-09-23T23:18:14.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5f2681dc-c9c7-4d04-8040-b19c2ddfd5a9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31282024-09-23T23:18:15.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 997c88cc-685b-45fc-9343-eb481bd666f4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31292024-09-23T23:18:15.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 997c88cc-685b-45fc-9343-eb481bd666f4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31302024-09-23T23:18:15.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 997c88cc-685b-45fc-9343-eb481bd666f4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31312024-09-23T23:18:16.179ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1445 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 2bdcaab8-c1a5-4514-9742-9aa55791681b response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
31322024-09-23T23:18:16.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = de02c5d7-4a0f-43a3-a4f3-f9713cb9523d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31332024-09-23T23:18:16.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = de02c5d7-4a0f-43a3-a4f3-f9713cb9523d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31342024-09-23T23:18:16.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = de02c5d7-4a0f-43a3-a4f3-f9713cb9523d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31352024-09-23T23:18:17.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3605fc36-0d5b-4c74-8c86-f21f1b16af5a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31362024-09-23T23:18:17.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3605fc36-0d5b-4c74-8c86-f21f1b16af5a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31372024-09-23T23:18:17.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3605fc36-0d5b-4c74-8c86-f21f1b16af5a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31382024-09-23T23:18:17.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
31392024-09-23T23:18:17.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31402024-09-23T23:18:17.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31412024-09-23T23:18:17.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31422024-09-23T23:18:17.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
31432024-09-23T23:18:17.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31442024-09-23T23:18:17.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31452024-09-23T23:18:17.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31462024-09-23T23:18:17.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31472024-09-23T23:18:17.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31482024-09-23T23:18:17.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31492024-09-23T23:18:17.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31502024-09-23T23:18:17.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31512024-09-23T23:18:17.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
31522024-09-23T23:18:17.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31532024-09-23T23:18:17.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31542024-09-23T23:18:17.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
31552024-09-23T23:18:17.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.340191ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
31562024-09-23T23:18:17.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31572024-09-23T23:18:17.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31582024-09-23T23:18:17.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.52981ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31592024-09-23T23:18:18.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c9b10ff7-fab7-4d43-8e90-487aec951aca roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31602024-09-23T23:18:18.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c9b10ff7-fab7-4d43-8e90-487aec951aca resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31612024-09-23T23:18:18.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c9b10ff7-fab7-4d43-8e90-487aec951aca response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31622024-09-23T23:18:18.948ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51938
31632024-09-23T23:18:18.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51938 req_id = ccf7dbfc-1daa-4579-95f0-1f43debfbf5e roles = RoleSet { roles: {} } uri = /metrics/producers
31642024-09-23T23:18:18.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51938 req_id = ccf7dbfc-1daa-4579-95f0-1f43debfbf5e resource = Database result = Ok(()) uri = /metrics/producers
31652024-09-23T23:18:18.981ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
31662024-09-23T23:18:18.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51938 req_id = ccf7dbfc-1daa-4579-95f0-1f43debfbf5e roles = RoleSet { roles: {} } uri = /metrics/producers
31672024-09-23T23:18:18.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51938 req_id = ccf7dbfc-1daa-4579-95f0-1f43debfbf5e resource = Database result = Ok(()) uri = /metrics/producers
31682024-09-23T23:18:18.986ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
31692024-09-23T23:18:18.986ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0eed348f-4630-46d6-9394-f59a82f336c7", "date": "Mon, 23 Sep 2024 23:18:18 GMT"} })
31702024-09-23T23:18:18.986ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = fd52d736-9d37-4f7f-81ce-c956fa9f23e3
31712024-09-23T23:18:18.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38855 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51938 req_id = ccf7dbfc-1daa-4579-95f0-1f43debfbf5e response_code = 201 uri = /metrics/producers
31722024-09-23T23:18:19.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7accbc73-60e1-4000-a563-0a2ee775b3d3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31732024-09-23T23:18:19.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7accbc73-60e1-4000-a563-0a2ee775b3d3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31742024-09-23T23:18:19.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7accbc73-60e1-4000-a563-0a2ee775b3d3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31752024-09-23T23:18:20.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4e6fc5cd-f3d1-48a5-95c6-ec3bb3072773 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31762024-09-23T23:18:20.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4e6fc5cd-f3d1-48a5-95c6-ec3bb3072773 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31772024-09-23T23:18:20.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4e6fc5cd-f3d1-48a5-95c6-ec3bb3072773 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31782024-09-23T23:18:21.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 21326226-68c2-47d3-aea7-e81df6697e85 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31792024-09-23T23:18:21.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 21326226-68c2-47d3-aea7-e81df6697e85 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31802024-09-23T23:18:21.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 21326226-68c2-47d3-aea7-e81df6697e85 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31812024-09-23T23:18:22.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 47405b12-12f9-4715-9320-d6052252736b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31822024-09-23T23:18:22.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 47405b12-12f9-4715-9320-d6052252736b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31832024-09-23T23:18:22.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 47405b12-12f9-4715-9320-d6052252736b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31842024-09-23T23:18:23.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2d3b8190-7d72-497f-bbaf-c683c6495cb9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31852024-09-23T23:18:23.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2d3b8190-7d72-497f-bbaf-c683c6495cb9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31862024-09-23T23:18:23.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2d3b8190-7d72-497f-bbaf-c683c6495cb9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31872024-09-23T23:18:24.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ec639f9f-a631-4cd6-8b3f-a18f1bc23267 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31882024-09-23T23:18:24.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ec639f9f-a631-4cd6-8b3f-a18f1bc23267 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31892024-09-23T23:18:24.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ec639f9f-a631-4cd6-8b3f-a18f1bc23267 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31902024-09-23T23:18:25.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a8d386c1-da3b-4bb2-870e-fb974aaaf2f2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31912024-09-23T23:18:25.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a8d386c1-da3b-4bb2-870e-fb974aaaf2f2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31922024-09-23T23:18:25.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a8d386c1-da3b-4bb2-870e-fb974aaaf2f2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31932024-09-23T23:18:26.179ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1315 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 31916dfb-1f59-4fab-bf59-31f321a8bb92 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
31942024-09-23T23:18:26.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b5cd5ad1-304f-407a-b9cd-bc3e18392c7b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31952024-09-23T23:18:26.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b5cd5ad1-304f-407a-b9cd-bc3e18392c7b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31962024-09-23T23:18:26.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b5cd5ad1-304f-407a-b9cd-bc3e18392c7b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
31972024-09-23T23:18:26.804ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48047
31982024-09-23T23:18:26.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48047 req_id = 895c24f7-69af-4d3c-a876-bd4fd0dc05b2 roles = RoleSet { roles: {} } uri = /metrics/producers
31992024-09-23T23:18:26.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48047 req_id = 895c24f7-69af-4d3c-a876-bd4fd0dc05b2 resource = Database result = Ok(()) uri = /metrics/producers
32002024-09-23T23:18:26.837ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
32012024-09-23T23:18:26.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48047 req_id = 895c24f7-69af-4d3c-a876-bd4fd0dc05b2 roles = RoleSet { roles: {} } uri = /metrics/producers
32022024-09-23T23:18:26.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48047 req_id = 895c24f7-69af-4d3c-a876-bd4fd0dc05b2 resource = Database result = Ok(()) uri = /metrics/producers
32032024-09-23T23:18:26.845ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
32042024-09-23T23:18:26.846ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "26cfe5a7-37d3-4d20-aa07-922fb2bc646d", "date": "Mon, 23 Sep 2024 23:18:26 GMT"} })
32052024-09-23T23:18:26.846ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = c1c0a7ac-2dfc-4b9c-8213-1795864579b6
32062024-09-23T23:18:26.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42286 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48047 req_id = 895c24f7-69af-4d3c-a876-bd4fd0dc05b2 response_code = 201 uri = /metrics/producers
32072024-09-23T23:18:27.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eac3555f-c39c-4cdd-a0e1-7ae1d925b86f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32082024-09-23T23:18:27.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eac3555f-c39c-4cdd-a0e1-7ae1d925b86f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32092024-09-23T23:18:27.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eac3555f-c39c-4cdd-a0e1-7ae1d925b86f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32102024-09-23T23:18:27.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
32112024-09-23T23:18:27.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32122024-09-23T23:18:27.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32132024-09-23T23:18:27.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
32142024-09-23T23:18:27.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32152024-09-23T23:18:27.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32162024-09-23T23:18:27.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32172024-09-23T23:18:27.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32182024-09-23T23:18:27.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32192024-09-23T23:18:27.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32202024-09-23T23:18:27.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32212024-09-23T23:18:27.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32222024-09-23T23:18:27.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32232024-09-23T23:18:27.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32242024-09-23T23:18:27.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.784287ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32252024-09-23T23:18:27.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32262024-09-23T23:18:27.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
32272024-09-23T23:18:27.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32282024-09-23T23:18:27.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32292024-09-23T23:18:27.856ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
32302024-09-23T23:18:27.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.456757ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
32312024-09-23T23:18:28.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1faa6c42-2532-47a7-94e0-695858f73890 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32322024-09-23T23:18:28.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1faa6c42-2532-47a7-94e0-695858f73890 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32332024-09-23T23:18:28.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1faa6c42-2532-47a7-94e0-695858f73890 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32342024-09-23T23:18:29.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e865d1d1-4334-423c-936b-fdb560ef4fed roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32352024-09-23T23:18:29.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e865d1d1-4334-423c-936b-fdb560ef4fed resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32362024-09-23T23:18:29.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e865d1d1-4334-423c-936b-fdb560ef4fed response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32372024-09-23T23:18:30.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8e28e2c1-05c7-47c3-97f0-e57f76c5f616 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32382024-09-23T23:18:30.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8e28e2c1-05c7-47c3-97f0-e57f76c5f616 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32392024-09-23T23:18:30.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8e28e2c1-05c7-47c3-97f0-e57f76c5f616 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32402024-09-23T23:18:31.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 82221bb3-0557-4795-b9a1-d5d538e01d11 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32412024-09-23T23:18:31.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 82221bb3-0557-4795-b9a1-d5d538e01d11 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32422024-09-23T23:18:31.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 82221bb3-0557-4795-b9a1-d5d538e01d11 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32432024-09-23T23:18:32.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ec65bfdb-b9c3-4895-9745-6ea27bc76400 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32442024-09-23T23:18:32.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ec65bfdb-b9c3-4895-9745-6ea27bc76400 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32452024-09-23T23:18:32.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ec65bfdb-b9c3-4895-9745-6ea27bc76400 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32462024-09-23T23:18:33.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a4338866-5b53-4b3d-99b0-a5daa0310b84 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32472024-09-23T23:18:33.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a4338866-5b53-4b3d-99b0-a5daa0310b84 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32482024-09-23T23:18:33.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a4338866-5b53-4b3d-99b0-a5daa0310b84 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32492024-09-23T23:18:34.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2bb997ae-70ec-4612-ad44-67d88f235d29 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32502024-09-23T23:18:34.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2bb997ae-70ec-4612-ad44-67d88f235d29 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32512024-09-23T23:18:34.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2bb997ae-70ec-4612-ad44-67d88f235d29 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32522024-09-23T23:18:35.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c2ccc401-b435-4a52-98fa-1100f32c21ad roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32532024-09-23T23:18:35.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c2ccc401-b435-4a52-98fa-1100f32c21ad resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32542024-09-23T23:18:35.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c2ccc401-b435-4a52-98fa-1100f32c21ad response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32552024-09-23T23:18:36.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = bb09287e-ce8e-4be6-bd4f-0629d37a5032 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
32562024-09-23T23:18:36.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7ce63804-d144-4b26-99aa-4763b559fd2f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32572024-09-23T23:18:36.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7ce63804-d144-4b26-99aa-4763b559fd2f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32582024-09-23T23:18:36.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7ce63804-d144-4b26-99aa-4763b559fd2f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
32592024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
32602024-09-23T23:18:37.802ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-23 23:08:37.802422333 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32612024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32622024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
32632024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32642024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
32652024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32662024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
32672024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
32682024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32692024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32702024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32712024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
32722024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
32732024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
32742024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
32752024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
32762024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32772024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32782024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
32792024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32802024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
32812024-09-23T23:18:37.802ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82
32822024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.94\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82"}
32832024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
32842024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32852024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32862024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32872024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32882024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32892024-09-23T23:18:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32902024-09-23T23:18:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32912024-09-23T23:18:37.803ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("954a3d10-a2dd-433b-9252-ede695863bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 688321554 } })
32922024-09-23T23:18:37.803ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65799211-2178-4ef6-a14b-629ea048347e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2729181-3180-4ecf-bd42-a48f1144b71d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 688373944 } })
32932024-09-23T23:18:37.803ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
32942024-09-23T23:18:37.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32952024-09-23T23:18:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32962024-09-23T23:18:37.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32972024-09-23T23:18:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32982024-09-23T23:18:37.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32992024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33002024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33012024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33022024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33032024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33042024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
33052024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33062024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
33072024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
33082024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33092024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33102024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
33112024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
33122024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33132024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
33142024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33152024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33162024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33172024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
33182024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
33192024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33202024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33212024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
33222024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
33232024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33242024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33252024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
33262024-09-23T23:18:37.804ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33272024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33282024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
33292024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33302024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
33312024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33322024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
33332024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33342024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
33352024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33362024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33372024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33382024-09-23T23:18:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33392024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33402024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33412024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33422024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33432024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33442024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33452024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33462024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33472024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33482024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33492024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33502024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33512024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
33522024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33532024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
33542024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33552024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
33562024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.023675ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
33572024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33582024-09-23T23:18:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33592024-09-23T23:18:37.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33602024-09-23T23:18:37.806ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-23 23:08:37.802422333 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
33612024-09-23T23:18:37.806ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.115287ms iteration = 7 status = {"expiration":"2024-09-23T23:08:37.802422333Z","pruned":[]}
33622024-09-23T23:18:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33632024-09-23T23:18:37.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33642024-09-23T23:18:37.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.187109ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33652024-09-23T23:18:37.806ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
33662024-09-23T23:18:37.806ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.36119ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
33672024-09-23T23:18:37.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 692003526 } })
33682024-09-23T23:18:37.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33692024-09-23T23:18:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33702024-09-23T23:18:37.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
33712024-09-23T23:18:37.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33722024-09-23T23:18:37.808ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 693239501 } })
33732024-09-23T23:18:37.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
33742024-09-23T23:18:37.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33752024-09-23T23:18:37.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33762024-09-23T23:18:37.808ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33772024-09-23T23:18:37.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33782024-09-23T23:18:37.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33792024-09-23T23:18:37.810ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33802024-09-23T23:18:37.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33812024-09-23T23:18:37.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33822024-09-23T23:18:37.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33832024-09-23T23:18:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33842024-09-23T23:18:37.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33852024-09-23T23:18:37.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33862024-09-23T23:18:37.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33872024-09-23T23:18:37.813ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33882024-09-23T23:18:37.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33892024-09-23T23:18:37.813ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33902024-09-23T23:18:37.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33912024-09-23T23:18:37.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33922024-09-23T23:18:37.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33932024-09-23T23:18:37.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33942024-09-23T23:18:37.816ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33952024-09-23T23:18:37.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33962024-09-23T23:18:37.816ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33972024-09-23T23:18:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33982024-09-23T23:18:37.818ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33992024-09-23T23:18:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34002024-09-23T23:18:37.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34012024-09-23T23:18:37.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34022024-09-23T23:18:37.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34032024-09-23T23:18:37.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34042024-09-23T23:18:37.823ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.637994ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
34052024-09-23T23:18:37.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34062024-09-23T23:18:37.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34072024-09-23T23:18:37.832ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34082024-09-23T23:18:37.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34092024-09-23T23:18:37.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34102024-09-23T23:18:37.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34112024-09-23T23:18:37.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34122024-09-23T23:18:37.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34132024-09-23T23:18:37.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34142024-09-23T23:18:37.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34152024-09-23T23:18:37.850ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34162024-09-23T23:18:37.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34172024-09-23T23:18:37.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34182024-09-23T23:18:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34192024-09-23T23:18:37.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34202024-09-23T23:18:37.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34212024-09-23T23:18:37.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34222024-09-23T23:18:37.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34232024-09-23T23:18:37.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34242024-09-23T23:18:37.863ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34252024-09-23T23:18:37.863ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34262024-09-23T23:18:37.863ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.896599ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34272024-09-23T23:18:37.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34282024-09-23T23:18:37.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34292024-09-23T23:18:37.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34302024-09-23T23:18:37.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34312024-09-23T23:18:37.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34322024-09-23T23:18:37.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34332024-09-23T23:18:37.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34342024-09-23T23:18:37.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34352024-09-23T23:18:37.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34362024-09-23T23:18:37.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
34372024-09-23T23:18:37.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34382024-09-23T23:18:37.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34392024-09-23T23:18:37.871ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34402024-09-23T23:18:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34412024-09-23T23:18:37.872ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422024-09-23T23:18:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34432024-09-23T23:18:37.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34442024-09-23T23:18:37.873ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 758173479 } })
34452024-09-23T23:18:37.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34462024-09-23T23:18:37.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.653961ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
34472024-09-23T23:18:37.873ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34482024-09-23T23:18:37.874ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34492024-09-23T23:18:37.874ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34502024-09-23T23:18:37.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34512024-09-23T23:18:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34522024-09-23T23:18:37.874ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
34532024-09-23T23:18:37.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34542024-09-23T23:18:37.875ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34552024-09-23T23:18:37.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34562024-09-23T23:18:37.877ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 74.297296ms iteration = 4 status = {"nsuccess":5}
34572024-09-23T23:18:37.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.020583ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34582024-09-23T23:18:37.878ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34592024-09-23T23:18:37.878ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34602024-09-23T23:18:37.878ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34612024-09-23T23:18:37.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34622024-09-23T23:18:37.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34632024-09-23T23:18:37.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34642024-09-23T23:18:37.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34652024-09-23T23:18:37.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34662024-09-23T23:18:37.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.332229ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
34672024-09-23T23:18:37.882ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34682024-09-23T23:18:37.882ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34692024-09-23T23:18:37.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34702024-09-23T23:18:37.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34712024-09-23T23:18:37.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34722024-09-23T23:18:37.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34732024-09-23T23:18:37.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34742024-09-23T23:18:37.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34752024-09-23T23:18:37.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34762024-09-23T23:18:37.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34772024-09-23T23:18:37.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782024-09-23T23:18:37.889ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
34792024-09-23T23:18:37.889ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.305306ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
34802024-09-23T23:18:37.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34812024-09-23T23:18:37.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34822024-09-23T23:18:37.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34832024-09-23T23:18:37.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34842024-09-23T23:18:37.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34852024-09-23T23:18:37.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34862024-09-23T23:18:37.893ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34872024-09-23T23:18:37.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34882024-09-23T23:18:37.895ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34892024-09-23T23:18:37.895ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.759306ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34902024-09-23T23:18:37.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34912024-09-23T23:18:37.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.906831ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34922024-09-23T23:18:37.903ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
34932024-09-23T23:18:37.903ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 98.849869ms iteration = 7 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
34942024-09-23T23:18:37.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34952024-09-23T23:18:37.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34962024-09-23T23:18:37.916ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34972024-09-23T23:18:37.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34982024-09-23T23:18:37.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34992024-09-23T23:18:37.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35002024-09-23T23:18:37.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.580932ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35012024-09-23T23:18:37.920ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35022024-09-23T23:18:37.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35032024-09-23T23:18:37.922ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35042024-09-23T23:18:37.922ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35052024-09-23T23:18:37.922ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.733357ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35062024-09-23T23:18:37.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35072024-09-23T23:18:37.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35082024-09-23T23:18:37.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35092024-09-23T23:18:37.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35102024-09-23T23:18:37.932ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35112024-09-23T23:18:37.932ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35122024-09-23T23:18:37.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35132024-09-23T23:18:37.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35142024-09-23T23:18:37.933ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35152024-09-23T23:18:37.933ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35162024-09-23T23:18:37.933ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.841215ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35172024-09-23T23:18:37.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182024-09-23T23:18:37.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
35192024-09-23T23:18:37.937ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35202024-09-23T23:18:37.937ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e5694b23-207b-474d-8668-d831088b9359", "content-length": "26", "date": "Mon, 23 Sep 2024 23:18:37 GMT"} })
35212024-09-23T23:18:37.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35222024-09-23T23:18:37.937ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35232024-09-23T23:18:37.939ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35242024-09-23T23:18:37.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35252024-09-23T23:18:37.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35262024-09-23T23:18:37.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35272024-09-23T23:18:37.945ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35282024-09-23T23:18:37.945ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35292024-09-23T23:18:37.945ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35302024-09-23T23:18:37.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35312024-09-23T23:18:37.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35322024-09-23T23:18:37.946ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
35332024-09-23T23:18:37.946ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35342024-09-23T23:18:37.946ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-23 23:12:39.428682 UTC dns_group = internal generation = 1
35352024-09-23T23:18:37.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 143.223801ms iteration = 8 status = {"generation":1}
35362024-09-23T23:18:37.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35372024-09-23T23:18:37.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35382024-09-23T23:18:37.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35392024-09-23T23:18:37.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35402024-09-23T23:18:37.958ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35412024-09-23T23:18:37.959ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35422024-09-23T23:18:37.959ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 0 version = 2
35432024-09-23T23:18:37.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35442024-09-23T23:18:37.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35452024-09-23T23:18:37.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f18d335c-01c0-46f8-92b6-84f6796e3002 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
35462024-09-23T23:18:37.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f18d335c-01c0-46f8-92b6-84f6796e3002 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
35472024-09-23T23:18:37.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f18d335c-01c0-46f8-92b6-84f6796e3002 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
35482024-09-23T23:18:37.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35492024-09-23T23:18:37.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35502024-09-23T23:18:37.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35512024-09-23T23:18:37.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35522024-09-23T23:18:37.974ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 1 version = 2
35532024-09-23T23:18:37.974ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35542024-09-23T23:18:37.974ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-23 23:12:40.294485 UTC dns_group = external generation = 2
35552024-09-23T23:18:37.974ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 171.987373ms iteration = 8 status = {"generation":2}
35562024-09-23T23:18:37.981ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 176.288602ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35572024-09-23T23:18:37.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35582024-09-23T23:18:37.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35592024-09-23T23:18:37.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35602024-09-23T23:18:37.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
35612024-09-23T23:18:37.990ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35622024-09-23T23:18:37.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35632024-09-23T23:18:37.992ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
35642024-09-23T23:18:37.992ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35652024-09-23T23:18:37.992ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8347fe8b-b107-429e-9091-941142571cb4", "content-length": "26", "date": "Mon, 23 Sep 2024 23:18:37 GMT"} })
35662024-09-23T23:18:37.992ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35672024-09-23T23:18:37.993ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 189.049669ms iteration = 13 status = 0
35682024-09-23T23:18:37.994ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35692024-09-23T23:18:37.996ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-23T23:12:36.221760Z, time_modified: 2024-09-23T23:12:36.221760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }) }
35702024-09-23T23:18:37.996ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 193.747883ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]}},"default_endpoint":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35712024-09-23T23:18:38.036ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 232.025834ms iteration = 16 status = {"physical_disks_added":0}
35722024-09-23T23:18:38.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35732024-09-23T23:18:38.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35742024-09-23T23:18:38.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752024-09-23T23:18:38.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35762024-09-23T23:18:38.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35772024-09-23T23:18:38.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35782024-09-23T23:18:38.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35792024-09-23T23:18:38.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35802024-09-23T23:18:38.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35812024-09-23T23:18:38.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35822024-09-23T23:18:38.088ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
35832024-09-23T23:18:38.088ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35842024-09-23T23:18:38.089ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6465a3be-e211-4dd1-951c-05ff0ebf06e7", "content-length": "26", "date": "Mon, 23 Sep 2024 23:18:37 GMT"} })
35852024-09-23T23:18:38.089ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35862024-09-23T23:18:38.091ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
35872024-09-23T23:18:38.143ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35882024-09-23T23:18:38.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35892024-09-23T23:18:38.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7e62ce2d-dfab-419f-a168-97571254a0b5", "date": "Mon, 23 Sep 2024 23:18:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35902024-09-23T23:18:38.149ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35912024-09-23T23:18:38.151ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4b628434-70cf-4ce5-89fa-42c9115c4d49", "date": "Mon, 23 Sep 2024 23:18:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35922024-09-23T23:18:38.151ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35932024-09-23T23:18:38.153ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35942024-09-23T23:18:38.153ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 351.196357ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35952024-09-23T23:18:38.160ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35962024-09-23T23:18:38.161ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90f4e4fe-66fe-43f4-a8b6-1bbfcd29f23a", "content-length": "1", "date": "Mon, 23 Sep 2024 23:18:38 GMT"} })
35972024-09-23T23:18:38.163ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35982024-09-23T23:18:38.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35992024-09-23T23:18:38.165ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 363.084854ms iteration = 13 status = null
36002024-09-23T23:18:38.184ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36012024-09-23T23:18:38.184ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "93343dd9-1a55-44f1-8324-85ea4eb9ed1d", "content-length": "372", "date": "Mon, 23 Sep 2024 23:18:37 GMT"} })
36022024-09-23T23:18:38.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36032024-09-23T23:18:38.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36042024-09-23T23:18:38.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36052024-09-23T23:18:38.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36062024-09-23T23:18:38.190ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 388.207964ms iteration = 13 status = {}
36072024-09-23T23:18:38.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36082024-09-23T23:18:38.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36092024-09-23T23:18:38.194ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36102024-09-23T23:18:38.194ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6c98cace-833f-4932-99be-17304357473e", "date": "Mon, 23 Sep 2024 23:18:37 GMT"} })
36112024-09-23T23:18:38.196ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.566012ms iteration = 14 status = {}
36122024-09-23T23:18:38.256ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36132024-09-23T23:18:38.259ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4127ab68-43cc-4922-aaaf-5f9802eaa618", "content-length": "691", "date": "Mon, 23 Sep 2024 23:18:37 GMT"} })
36142024-09-23T23:18:38.259ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36152024-09-23T23:18:38.259ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36162024-09-23T23:18:38.259ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36172024-09-23T23:18:38.261ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.694443ms iteration = 13 status = {}
36182024-09-23T23:18:38.264ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36192024-09-23T23:18:38.264ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "794ebdf0-a92c-4023-9c7c-f11584ee436b", "date": "Mon, 23 Sep 2024 23:18:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36202024-09-23T23:18:38.264ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36212024-09-23T23:18:38.266ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "73fef7a9-b975-4f0d-8763-aa02b3e74a69", "date": "Mon, 23 Sep 2024 23:18:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36222024-09-23T23:18:38.266ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36232024-09-23T23:18:38.268ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c58115c6-1b87-43bd-a785-eb1d983973f5", "date": "Mon, 23 Sep 2024 23:18:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36242024-09-23T23:18:38.268ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36252024-09-23T23:18:38.270ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36262024-09-23T23:18:38.270ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 467.884282ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36272024-09-23T23:18:38.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36282024-09-23T23:18:38.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36292024-09-23T23:18:38.315ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
36302024-09-23T23:18:38.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36312024-09-23T23:18:38.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36322024-09-23T23:18:38.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36332024-09-23T23:18:38.325ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14eaeb9a-512a-45b2-84d5-e976eaec30f7", "content-length": "121", "date": "Mon, 23 Sep 2024 23:18:38 GMT"} })
36342024-09-23T23:18:38.325ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
36352024-09-23T23:18:38.325ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
36362024-09-23T23:18:38.325ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36372024-09-23T23:18:38.325ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36382024-09-23T23:18:38.325ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
36392024-09-23T23:18:38.325ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
36402024-09-23T23:18:38.325ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
36412024-09-23T23:18:38.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36422024-09-23T23:18:38.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36432024-09-23T23:18:38.327ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36442024-09-23T23:18:38.327ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9f75069-c8e3-445c-818b-eaf0744bb9be", "content-length": "2", "date": "Mon, 23 Sep 2024 23:18:38 GMT"} })
36452024-09-23T23:18:38.327ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36462024-09-23T23:18:38.328ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c79b654d-7368-4758-8b09-5ae43c7f7d98", "content-length": "52", "date": "Mon, 23 Sep 2024 23:18:38 GMT"} })
36472024-09-23T23:18:38.328ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
36482024-09-23T23:18:38.328ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36492024-09-23T23:18:38.472ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8c753b41-3978-47d5-8e8b-bbcb50513630", "date": "Mon, 23 Sep 2024 23:18:37 GMT"} })
36502024-09-23T23:18:38.472ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
36512024-09-23T23:18:38.472ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36522024-09-23T23:18:38.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "471ca204-c9c0-4597-bf22-1eebaf70cc79", "content-length": "667", "date": "Mon, 23 Sep 2024 23:18:38 GMT"} })
36532024-09-23T23:18:38.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36542024-09-23T23:18:38.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36552024-09-23T23:18:38.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36562024-09-23T23:18:38.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36572024-09-23T23:18:38.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36582024-09-23T23:18:38.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36592024-09-23T23:18:38.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36602024-09-23T23:18:38.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36612024-09-23T23:18:38.489ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 684.758442ms iteration = 13 status = {}
36622024-09-23T23:18:38.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 5aab7801-6f9f-4ea1-b6f3-aff2851a63c2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36632024-09-23T23:18:38.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 5aab7801-6f9f-4ea1-b6f3-aff2851a63c2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36642024-09-23T23:18:38.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 5aab7801-6f9f-4ea1-b6f3-aff2851a63c2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36652024-09-23T23:18:38.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f27fb345-b0c0-4c3c-a567-2bc6d1446f11 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36662024-09-23T23:18:38.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f27fb345-b0c0-4c3c-a567-2bc6d1446f11 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36672024-09-23T23:18:38.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f27fb345-b0c0-4c3c-a567-2bc6d1446f11 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36682024-09-23T23:18:40.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 226c4c8b-d326-4bd8-b3d4-c6ef73256ab6 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36692024-09-23T23:18:40.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 226c4c8b-d326-4bd8-b3d4-c6ef73256ab6 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36702024-09-23T23:18:40.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 226c4c8b-d326-4bd8-b3d4-c6ef73256ab6 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36712024-09-23T23:18:41.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f5de8e39-ca72-4855-9ad2-1828f13b9641 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36722024-09-23T23:18:41.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f5de8e39-ca72-4855-9ad2-1828f13b9641 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36732024-09-23T23:18:41.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f5de8e39-ca72-4855-9ad2-1828f13b9641 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36742024-09-23T23:18:42.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bd57f514-214c-4f27-acbb-6c09bae795cf roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36752024-09-23T23:18:42.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bd57f514-214c-4f27-acbb-6c09bae795cf resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36762024-09-23T23:18:42.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bd57f514-214c-4f27-acbb-6c09bae795cf response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36772024-09-23T23:18:43.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ef35f6fc-6175-4aec-a9d5-3937af4b6cd8 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36782024-09-23T23:18:43.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ef35f6fc-6175-4aec-a9d5-3937af4b6cd8 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36792024-09-23T23:18:43.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ef35f6fc-6175-4aec-a9d5-3937af4b6cd8 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36802024-09-23T23:18:44.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3b88528c-6c1d-4649-b920-4dc070d07aeb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36812024-09-23T23:18:44.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3b88528c-6c1d-4649-b920-4dc070d07aeb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36822024-09-23T23:18:44.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3b88528c-6c1d-4649-b920-4dc070d07aeb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36832024-09-23T23:18:45.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1e33a89a-0de7-46d1-b626-a7d4dc3d005f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36842024-09-23T23:18:45.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1e33a89a-0de7-46d1-b626-a7d4dc3d005f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36852024-09-23T23:18:45.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1e33a89a-0de7-46d1-b626-a7d4dc3d005f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36862024-09-23T23:18:46.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d9f4a598-6dd9-4bd9-bde8-c1d7d2e231a9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36872024-09-23T23:18:46.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d9f4a598-6dd9-4bd9-bde8-c1d7d2e231a9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36882024-09-23T23:18:46.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d9f4a598-6dd9-4bd9-bde8-c1d7d2e231a9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
36892024-09-23T23:18:46.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = d452adfa-4f1f-4bc6-9e5d-be2b18616624 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
36902024-09-23T23:18:46.855ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47855
36912024-09-23T23:18:46.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47855 req_id = de17e2d5-cdf0-40c4-a772-708773fb3349 roles = RoleSet { roles: {} } uri = /metrics/producers
36922024-09-23T23:18:46.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47855 req_id = de17e2d5-cdf0-40c4-a772-708773fb3349 resource = Database result = Ok(()) uri = /metrics/producers
36932024-09-23T23:18:46.888ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
36942024-09-23T23:18:46.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47855 req_id = de17e2d5-cdf0-40c4-a772-708773fb3349 roles = RoleSet { roles: {} } uri = /metrics/producers
36952024-09-23T23:18:46.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47855 req_id = de17e2d5-cdf0-40c4-a772-708773fb3349 resource = Database result = Ok(()) uri = /metrics/producers
36962024-09-23T23:18:46.919ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
36972024-09-23T23:18:46.920ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0223932b-5eed-4894-8374-ac9d069255e4", "date": "Mon, 23 Sep 2024 23:18:46 GMT"} })
36982024-09-23T23:18:46.920ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = ac854ddf-1dd0-4658-bc1c-106b334d06aa
36992024-09-23T23:18:46.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66934 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47855 req_id = de17e2d5-cdf0-40c4-a772-708773fb3349 response_code = 201 uri = /metrics/producers
37002024-09-23T23:18:47.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 785d4b95-3268-45bb-bd28-5942fe28e3e8 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37012024-09-23T23:18:47.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 785d4b95-3268-45bb-bd28-5942fe28e3e8 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37022024-09-23T23:18:47.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 785d4b95-3268-45bb-bd28-5942fe28e3e8 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37032024-09-23T23:18:47.191ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55254
37042024-09-23T23:18:47.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55254 req_id = 08e5cf78-ee76-49cf-92fe-f96673a1458d roles = RoleSet { roles: {} } uri = /metrics/producers
37052024-09-23T23:18:47.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55254 req_id = 08e5cf78-ee76-49cf-92fe-f96673a1458d resource = Database result = Ok(()) uri = /metrics/producers
37062024-09-23T23:18:47.224ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
37072024-09-23T23:18:47.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55254 req_id = 08e5cf78-ee76-49cf-92fe-f96673a1458d roles = RoleSet { roles: {} } uri = /metrics/producers
37082024-09-23T23:18:47.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55254 req_id = 08e5cf78-ee76-49cf-92fe-f96673a1458d resource = Database result = Ok(()) uri = /metrics/producers
37092024-09-23T23:18:47.258ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
37102024-09-23T23:18:47.258ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f9985d2d-49b1-474d-a647-d753f25ef7fe", "date": "Mon, 23 Sep 2024 23:18:46 GMT"} })
37112024-09-23T23:18:47.258ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = 33a0a3ef-fb4e-4eb6-bc0e-5a150e0c94ea
37122024-09-23T23:18:47.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 67854 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55254 req_id = 08e5cf78-ee76-49cf-92fe-f96673a1458d response_code = 201 uri = /metrics/producers
37132024-09-23T23:18:47.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
37142024-09-23T23:18:47.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37152024-09-23T23:18:47.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37162024-09-23T23:18:47.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172024-09-23T23:18:47.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
37182024-09-23T23:18:47.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37192024-09-23T23:18:47.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37202024-09-23T23:18:47.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37212024-09-23T23:18:47.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37222024-09-23T23:18:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37232024-09-23T23:18:47.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37242024-09-23T23:18:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37252024-09-23T23:18:47.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37262024-09-23T23:18:47.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37272024-09-23T23:18:47.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.588532ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37282024-09-23T23:18:47.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37292024-09-23T23:18:47.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
37302024-09-23T23:18:47.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37312024-09-23T23:18:47.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37322024-09-23T23:18:47.818ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
37332024-09-23T23:18:47.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.077426ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
37342024-09-23T23:18:48.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4252d948-8462-4416-b38c-5f3a5567257f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37352024-09-23T23:18:48.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4252d948-8462-4416-b38c-5f3a5567257f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37362024-09-23T23:18:48.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4252d948-8462-4416-b38c-5f3a5567257f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37372024-09-23T23:18:49.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 42f320af-dc4b-43a1-8f53-7b177a4ec414 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37382024-09-23T23:18:49.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 42f320af-dc4b-43a1-8f53-7b177a4ec414 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37392024-09-23T23:18:49.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 42f320af-dc4b-43a1-8f53-7b177a4ec414 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37402024-09-23T23:18:50.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3f130437-b093-4145-8039-7d9fb87ca8d3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37412024-09-23T23:18:50.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3f130437-b093-4145-8039-7d9fb87ca8d3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37422024-09-23T23:18:50.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3f130437-b093-4145-8039-7d9fb87ca8d3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37432024-09-23T23:18:51.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c9e24873-1805-4b02-8c69-4696ba51f559 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37442024-09-23T23:18:51.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c9e24873-1805-4b02-8c69-4696ba51f559 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37452024-09-23T23:18:51.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c9e24873-1805-4b02-8c69-4696ba51f559 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37462024-09-23T23:18:52.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c398f7a8-0867-4549-8150-21ce5bc51d1a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37472024-09-23T23:18:52.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c398f7a8-0867-4549-8150-21ce5bc51d1a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37482024-09-23T23:18:52.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c398f7a8-0867-4549-8150-21ce5bc51d1a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37492024-09-23T23:18:53.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e2323581-6577-4be6-8f9a-cbeb38b17678 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37502024-09-23T23:18:53.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e2323581-6577-4be6-8f9a-cbeb38b17678 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37512024-09-23T23:18:53.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e2323581-6577-4be6-8f9a-cbeb38b17678 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37522024-09-23T23:18:54.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8eb8fab7-ccbe-42bd-8c65-14025a8fe4cb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37532024-09-23T23:18:54.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8eb8fab7-ccbe-42bd-8c65-14025a8fe4cb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37542024-09-23T23:18:54.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8eb8fab7-ccbe-42bd-8c65-14025a8fe4cb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37552024-09-23T23:18:55.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 21f946c6-0033-4bfc-85cb-aba667d57b15 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37562024-09-23T23:18:55.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 21f946c6-0033-4bfc-85cb-aba667d57b15 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37572024-09-23T23:18:55.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 21f946c6-0033-4bfc-85cb-aba667d57b15 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37582024-09-23T23:18:56.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 3288d95e-69e1-4059-b46c-36c6f289f272 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
37592024-09-23T23:18:56.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 13e9695c-e5be-43ad-9910-82ea2d39d331 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37602024-09-23T23:18:56.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 13e9695c-e5be-43ad-9910-82ea2d39d331 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37612024-09-23T23:18:56.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 13e9695c-e5be-43ad-9910-82ea2d39d331 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37622024-09-23T23:18:57.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5b4a89c3-ceac-412c-9922-61ed601d3b66 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37632024-09-23T23:18:57.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5b4a89c3-ceac-412c-9922-61ed601d3b66 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37642024-09-23T23:18:57.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5b4a89c3-ceac-412c-9922-61ed601d3b66 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37652024-09-23T23:18:57.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
37662024-09-23T23:18:57.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37672024-09-23T23:18:57.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37682024-09-23T23:18:57.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
37692024-09-23T23:18:57.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37702024-09-23T23:18:57.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37712024-09-23T23:18:57.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37722024-09-23T23:18:57.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37732024-09-23T23:18:57.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37742024-09-23T23:18:57.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37752024-09-23T23:18:57.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37762024-09-23T23:18:57.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37772024-09-23T23:18:57.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37782024-09-23T23:18:57.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
37792024-09-23T23:18:57.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37802024-09-23T23:18:57.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37812024-09-23T23:18:57.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
37822024-09-23T23:18:57.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.289239ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
37832024-09-23T23:18:57.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37842024-09-23T23:18:57.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37852024-09-23T23:18:57.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.152582ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37862024-09-23T23:18:58.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 617fe0b3-447e-4d4b-9c61-b283cc2ef950 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37872024-09-23T23:18:58.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 617fe0b3-447e-4d4b-9c61-b283cc2ef950 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37882024-09-23T23:18:58.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 617fe0b3-447e-4d4b-9c61-b283cc2ef950 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37892024-09-23T23:18:59.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6469d34a-5d1b-472e-8943-81f428d74cbe roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37902024-09-23T23:18:59.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6469d34a-5d1b-472e-8943-81f428d74cbe resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37912024-09-23T23:18:59.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6469d34a-5d1b-472e-8943-81f428d74cbe response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37922024-09-23T23:19:00.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a918ae16-a2b3-4cac-a516-83b8748a5826 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37932024-09-23T23:19:00.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a918ae16-a2b3-4cac-a516-83b8748a5826 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37942024-09-23T23:19:00.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a918ae16-a2b3-4cac-a516-83b8748a5826 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37952024-09-23T23:19:01.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c407da78-68cf-4376-9e29-1954f0a97540 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37962024-09-23T23:19:01.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c407da78-68cf-4376-9e29-1954f0a97540 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37972024-09-23T23:19:01.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c407da78-68cf-4376-9e29-1954f0a97540 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37982024-09-23T23:19:02.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c217ec3-06e3-401c-997b-e8d872d4cc71 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
37992024-09-23T23:19:02.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c217ec3-06e3-401c-997b-e8d872d4cc71 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38002024-09-23T23:19:02.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c217ec3-06e3-401c-997b-e8d872d4cc71 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38012024-09-23T23:19:03.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4cceab31-f154-456a-82a0-0d6b2c57568e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38022024-09-23T23:19:03.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4cceab31-f154-456a-82a0-0d6b2c57568e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38032024-09-23T23:19:03.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4cceab31-f154-456a-82a0-0d6b2c57568e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38042024-09-23T23:19:04.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c6cb8dfa-754c-4a25-8ee9-1fcc21da5f25 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38052024-09-23T23:19:04.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c6cb8dfa-754c-4a25-8ee9-1fcc21da5f25 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38062024-09-23T23:19:04.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c6cb8dfa-754c-4a25-8ee9-1fcc21da5f25 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38072024-09-23T23:19:05.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fcffc5a6-baa4-4356-8e0c-62e50e1d4bbd roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38082024-09-23T23:19:05.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fcffc5a6-baa4-4356-8e0c-62e50e1d4bbd resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38092024-09-23T23:19:05.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fcffc5a6-baa4-4356-8e0c-62e50e1d4bbd response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38102024-09-23T23:19:06.179ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1527 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 2876bdd1-7c2b-4cac-8601-e4d28ef28cfc response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
38112024-09-23T23:19:06.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1a2ac5fa-c296-49de-9722-586b16920574 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38122024-09-23T23:19:06.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1a2ac5fa-c296-49de-9722-586b16920574 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38132024-09-23T23:19:06.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1a2ac5fa-c296-49de-9722-586b16920574 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38142024-09-23T23:19:07.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 90ca9fc1-6386-460d-bc84-cf40361fd7f5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38152024-09-23T23:19:07.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 90ca9fc1-6386-460d-bc84-cf40361fd7f5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38162024-09-23T23:19:07.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 90ca9fc1-6386-460d-bc84-cf40361fd7f5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
38172024-09-23T23:19:07.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
38182024-09-23T23:19:07.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
38192024-09-23T23:19:07.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38202024-09-23T23:19:07.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38212024-09-23T23:19:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38222024-09-23T23:19:07.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38232024-09-23T23:19:07.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
38242024-09-23T23:19:07.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
38252024-09-23T23:19:07.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38262024-09-23T23:19:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38272024-09-23T23:19:07.804ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 689042262 } })
38282024-09-23T23:19:07.804ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
38292024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38302024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
38312024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
38322024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38332024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38342024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
38352024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
38362024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38372024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
38382024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38392024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38402024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
38412024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38422024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
38432024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
38442024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38452024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38462024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
38472024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38482024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
38492024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38502024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
38512024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38522024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38532024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38542024-09-23T23:19:07.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 690487689 } })
38552024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38562024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
38572024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
38582024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38592024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38602024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38612024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38622024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38632024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38642024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38652024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38662024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38672024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38682024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38692024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38702024-09-23T23:19:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38712024-09-23T23:19:07.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
38722024-09-23T23:19:07.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.972946ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38732024-09-23T23:19:07.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38742024-09-23T23:19:07.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752024-09-23T23:19:07.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38762024-09-23T23:19:07.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38772024-09-23T23:19:07.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38782024-09-23T23:19:07.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38792024-09-23T23:19:07.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38802024-09-23T23:19:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38812024-09-23T23:19:07.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38822024-09-23T23:19:07.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38832024-09-23T23:19:07.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38842024-09-23T23:19:07.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38852024-09-23T23:19:07.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38862024-09-23T23:19:07.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38872024-09-23T23:19:07.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38882024-09-23T23:19:07.813ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38892024-09-23T23:19:07.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38902024-09-23T23:19:07.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912024-09-23T23:19:07.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38922024-09-23T23:19:07.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38932024-09-23T23:19:07.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38942024-09-23T23:19:07.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38952024-09-23T23:19:07.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38962024-09-23T23:19:07.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38972024-09-23T23:19:07.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38982024-09-23T23:19:07.820ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 705025576 } })
38992024-09-23T23:19:07.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39002024-09-23T23:19:07.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39012024-09-23T23:19:07.820ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
39022024-09-23T23:19:07.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39032024-09-23T23:19:07.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39042024-09-23T23:19:07.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39052024-09-23T23:19:07.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39062024-09-23T23:19:07.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39072024-09-23T23:19:07.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
39082024-09-23T23:19:07.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39092024-09-23T23:19:07.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39102024-09-23T23:19:07.838ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
39112024-09-23T23:19:07.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.60189ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
39122024-09-23T23:19:07.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39132024-09-23T23:19:07.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39142024-09-23T23:19:07.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39152024-09-23T23:19:07.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39162024-09-23T23:19:07.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.831773ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
39172024-09-23T23:19:07.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39182024-09-23T23:19:07.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39192024-09-23T23:19:07.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39202024-09-23T23:19:07.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39212024-09-23T23:19:07.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39222024-09-23T23:19:07.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.627838ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39232024-09-23T23:19:07.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39242024-09-23T23:19:07.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39252024-09-23T23:19:07.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.851451ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
39262024-09-23T23:19:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39272024-09-23T23:19:07.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39282024-09-23T23:19:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39292024-09-23T23:19:07.855ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39302024-09-23T23:19:07.855ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39312024-09-23T23:19:07.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39322024-09-23T23:19:07.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39332024-09-23T23:19:07.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.259051ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39342024-09-23T23:19:07.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39352024-09-23T23:19:07.858ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39362024-09-23T23:19:07.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39372024-09-23T23:19:07.859ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39382024-09-23T23:19:07.859ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39392024-09-23T23:19:07.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39402024-09-23T23:19:07.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39412024-09-23T23:19:07.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
39422024-09-23T23:19:07.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39432024-09-23T23:19:07.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39442024-09-23T23:19:07.861ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.692163ms iteration = 14 status = 0
39452024-09-23T23:19:07.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39462024-09-23T23:19:07.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39472024-09-23T23:19:07.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39482024-09-23T23:19:07.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39492024-09-23T23:19:07.886ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39502024-09-23T23:19:07.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39512024-09-23T23:19:07.893ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39522024-09-23T23:19:07.893ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39532024-09-23T23:19:07.893ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.347248ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39542024-09-23T23:19:07.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.226962ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39552024-09-23T23:19:07.911ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39562024-09-23T23:19:07.911ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.992302ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39572024-09-23T23:19:07.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
39582024-09-23T23:19:07.920ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39592024-09-23T23:19:07.921ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "95c1e0f9-8fa0-4bff-8f33-26f6277c4d45", "content-length": "26", "date": "Mon, 23 Sep 2024 23:19:07 GMT"} })
39602024-09-23T23:19:07.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39612024-09-23T23:19:07.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39622024-09-23T23:19:07.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.507015ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39632024-09-23T23:19:07.994ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
39642024-09-23T23:19:07.994ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39652024-09-23T23:19:07.995ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ff97c5d8-ce56-4309-ab48-776f6792a49d", "content-length": "26", "date": "Mon, 23 Sep 2024 23:19:07 GMT"} })
39662024-09-23T23:19:07.995ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39672024-09-23T23:19:07.997ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39682024-09-23T23:19:08.005ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 200.387469ms iteration = 17 status = {"physical_disks_added":0}
39692024-09-23T23:19:08.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39702024-09-23T23:19:08.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39712024-09-23T23:19:08.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39722024-09-23T23:19:08.011ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
39732024-09-23T23:19:08.011ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39742024-09-23T23:19:08.011ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "26c0b28d-0663-4fb4-be07-f215c25701a8", "content-length": "26", "date": "Mon, 23 Sep 2024 23:19:07 GMT"} })
39752024-09-23T23:19:08.011ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39762024-09-23T23:19:08.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39772024-09-23T23:19:08.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39782024-09-23T23:19:08.013ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
39792024-09-23T23:19:08.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39802024-09-23T23:19:08.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39812024-09-23T23:19:08.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39822024-09-23T23:19:08.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39832024-09-23T23:19:08.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39842024-09-23T23:19:08.019ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39852024-09-23T23:19:08.019ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8dde81cd-333e-448d-a440-e2a6393c74e0", "content-length": "372", "date": "Mon, 23 Sep 2024 23:19:07 GMT"} })
39862024-09-23T23:19:08.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39872024-09-23T23:19:08.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39882024-09-23T23:19:08.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39892024-09-23T23:19:08.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39902024-09-23T23:19:08.040ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 238.731211ms iteration = 14 status = {}
39912024-09-23T23:19:08.115ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
39922024-09-23T23:19:08.115ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "461c8e23-1588-4d66-8014-4fa937237f58", "content-length": "1", "date": "Mon, 23 Sep 2024 23:19:08 GMT"} })
39932024-09-23T23:19:08.117ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39942024-09-23T23:19:08.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39952024-09-23T23:19:08.185ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39962024-09-23T23:19:08.186ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 384.794974ms iteration = 14 status = null
39972024-09-23T23:19:08.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39982024-09-23T23:19:08.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39992024-09-23T23:19:08.191ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40002024-09-23T23:19:08.204ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "25acee3f-fa7d-4177-96db-95f9439be779", "date": "Mon, 23 Sep 2024 23:19:08 GMT"} })
40012024-09-23T23:19:08.206ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 400.700578ms iteration = 15 status = {}
40022024-09-23T23:19:08.206ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "974d2b55-333b-4cb4-b96a-7b389b0a3f98", "content-length": "691", "date": "Mon, 23 Sep 2024 23:19:08 GMT"} })
40032024-09-23T23:19:08.206ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40042024-09-23T23:19:08.206ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40052024-09-23T23:19:08.206ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40062024-09-23T23:19:08.208ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 403.082625ms iteration = 14 status = {}
40072024-09-23T23:19:08.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40082024-09-23T23:19:08.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40092024-09-23T23:19:08.246ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
40102024-09-23T23:19:08.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40112024-09-23T23:19:08.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40122024-09-23T23:19:08.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40132024-09-23T23:19:08.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1cad30e9-e6b5-4555-b5e8-4746086aa4ff", "content-length": "121", "date": "Mon, 23 Sep 2024 23:19:08 GMT"} })
40142024-09-23T23:19:08.252ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
40152024-09-23T23:19:08.252ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
40162024-09-23T23:19:08.253ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40172024-09-23T23:19:08.253ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40182024-09-23T23:19:08.253ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
40192024-09-23T23:19:08.253ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
40202024-09-23T23:19:08.253ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
40212024-09-23T23:19:08.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40222024-09-23T23:19:08.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40232024-09-23T23:19:08.255ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40242024-09-23T23:19:08.255ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "40b72f54-391f-4715-8d6d-353e61d99b32", "content-length": "2", "date": "Mon, 23 Sep 2024 23:19:08 GMT"} })
40252024-09-23T23:19:08.255ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40262024-09-23T23:19:08.255ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d241addc-9e95-4168-8764-f10a30e49130", "content-length": "52", "date": "Mon, 23 Sep 2024 23:19:08 GMT"} })
40272024-09-23T23:19:08.255ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
40282024-09-23T23:19:08.255ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40292024-09-23T23:19:08.444ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4003ecb8-e19e-4e3a-a847-895dbf5631a0", "date": "Mon, 23 Sep 2024 23:19:08 GMT"} })
40302024-09-23T23:19:08.444ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
40312024-09-23T23:19:08.444ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40322024-09-23T23:19:08.445ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "afac1d56-a1e7-4621-8fd7-d49d51aba101", "content-length": "667", "date": "Mon, 23 Sep 2024 23:19:08 GMT"} })
40332024-09-23T23:19:08.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40342024-09-23T23:19:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40352024-09-23T23:19:08.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40362024-09-23T23:19:08.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40372024-09-23T23:19:08.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40382024-09-23T23:19:08.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40392024-09-23T23:19:08.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40402024-09-23T23:19:08.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40412024-09-23T23:19:08.465ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 660.551003ms iteration = 14 status = {}
40422024-09-23T23:19:08.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 97426ef6-3629-4da9-bd3f-05b62bd345f7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
40432024-09-23T23:19:08.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 97426ef6-3629-4da9-bd3f-05b62bd345f7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
40442024-09-23T23:19:08.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 97426ef6-3629-4da9-bd3f-05b62bd345f7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
40452024-09-23T23:19:08.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 00f95f90-fef1-4c8a-9f2a-cd0e9f11aa68 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40462024-09-23T23:19:08.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 00f95f90-fef1-4c8a-9f2a-cd0e9f11aa68 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40472024-09-23T23:19:08.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 00f95f90-fef1-4c8a-9f2a-cd0e9f11aa68 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40482024-09-23T23:19:09.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 22c38bb6-51b0-4319-947e-b091e12023a7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40492024-09-23T23:19:09.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 22c38bb6-51b0-4319-947e-b091e12023a7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40502024-09-23T23:19:09.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 22c38bb6-51b0-4319-947e-b091e12023a7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40512024-09-23T23:19:10.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62333629-83b9-4ec1-b362-f22706d9530a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40522024-09-23T23:19:10.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62333629-83b9-4ec1-b362-f22706d9530a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40532024-09-23T23:19:10.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62333629-83b9-4ec1-b362-f22706d9530a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40542024-09-23T23:19:11.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7ca7d32f-94a0-43ad-a7a7-4cc7ce44c81f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40552024-09-23T23:19:11.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7ca7d32f-94a0-43ad-a7a7-4cc7ce44c81f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40562024-09-23T23:19:11.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7ca7d32f-94a0-43ad-a7a7-4cc7ce44c81f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40572024-09-23T23:19:12.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = f51df541-763b-4ea3-ac35-88d6a0047cad roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
40582024-09-23T23:19:12.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = f51df541-763b-4ea3-ac35-88d6a0047cad resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
40592024-09-23T23:19:12.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = f51df541-763b-4ea3-ac35-88d6a0047cad response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
40602024-09-23T23:19:12.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 1bc00ec6-10bd-479c-91c1-794e27250ca5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
40612024-09-23T23:19:12.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 1bc00ec6-10bd-479c-91c1-794e27250ca5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
40622024-09-23T23:19:12.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 1bc00ec6-10bd-479c-91c1-794e27250ca5 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
40632024-09-23T23:19:12.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = aca5d9db-0e43-4c83-b16c-686677692b77 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40642024-09-23T23:19:12.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = aca5d9db-0e43-4c83-b16c-686677692b77 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40652024-09-23T23:19:12.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = aca5d9db-0e43-4c83-b16c-686677692b77 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40662024-09-23T23:19:13.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e6fbd31a-e34b-4c2c-958f-add48440dc47 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40672024-09-23T23:19:13.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e6fbd31a-e34b-4c2c-958f-add48440dc47 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40682024-09-23T23:19:13.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e6fbd31a-e34b-4c2c-958f-add48440dc47 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40692024-09-23T23:19:14.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d24fd8d8-4b8e-4a1a-966a-c341ef322855 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40702024-09-23T23:19:14.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d24fd8d8-4b8e-4a1a-966a-c341ef322855 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40712024-09-23T23:19:14.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d24fd8d8-4b8e-4a1a-966a-c341ef322855 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40722024-09-23T23:19:15.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 69fa92c8-e764-4fb8-bdf0-6be39572a681 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40732024-09-23T23:19:15.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 69fa92c8-e764-4fb8-bdf0-6be39572a681 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40742024-09-23T23:19:15.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 69fa92c8-e764-4fb8-bdf0-6be39572a681 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40752024-09-23T23:19:16.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 55609e38-0417-4460-8e4e-b352a014586d response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
40762024-09-23T23:19:16.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ff95b9c7-0be6-4a3f-b940-8e418c555925 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40772024-09-23T23:19:16.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ff95b9c7-0be6-4a3f-b940-8e418c555925 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40782024-09-23T23:19:16.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ff95b9c7-0be6-4a3f-b940-8e418c555925 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
40792024-09-23T23:19:17.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
40802024-09-23T23:19:17.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40812024-09-23T23:19:17.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40822024-09-23T23:19:17.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
40832024-09-23T23:19:17.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40842024-09-23T23:19:17.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40852024-09-23T23:19:17.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40862024-09-23T23:19:17.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40872024-09-23T23:19:17.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40882024-09-23T23:19:17.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40892024-09-23T23:19:17.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40902024-09-23T23:19:17.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40912024-09-23T23:19:17.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.695102ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40922024-09-23T23:19:17.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40932024-09-23T23:19:17.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40942024-09-23T23:19:17.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40952024-09-23T23:19:17.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
40962024-09-23T23:19:17.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40972024-09-23T23:19:17.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40982024-09-23T23:19:17.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
40992024-09-23T23:19:17.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.515636ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
41002024-09-23T23:19:17.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 97f32c90-4821-498d-b48d-bc4782a7e0cf roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41012024-09-23T23:19:17.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 97f32c90-4821-498d-b48d-bc4782a7e0cf resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41022024-09-23T23:19:17.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 97f32c90-4821-498d-b48d-bc4782a7e0cf response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41032024-09-23T23:19:18.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c83d8da4-6e29-4a06-9e8d-854d8c5ed55e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41042024-09-23T23:19:18.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c83d8da4-6e29-4a06-9e8d-854d8c5ed55e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41052024-09-23T23:19:18.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c83d8da4-6e29-4a06-9e8d-854d8c5ed55e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41062024-09-23T23:19:19.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 04c444d0-2327-4348-b19e-3e9dcf617363 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41072024-09-23T23:19:19.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 04c444d0-2327-4348-b19e-3e9dcf617363 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41082024-09-23T23:19:19.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 04c444d0-2327-4348-b19e-3e9dcf617363 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41092024-09-23T23:19:20.809ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1993 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5cb296c-eee1-4c94-b342-5dffe2d87ff3 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-23T23:19:20.798769742Z }
41102024-09-23T23:19:20.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5cb296c-eee1-4c94-b342-5dffe2d87ff3 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
41112024-09-23T23:19:20.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5cb296c-eee1-4c94-b342-5dffe2d87ff3 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
41122024-09-23T23:19:20.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 25682 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5cb296c-eee1-4c94-b342-5dffe2d87ff3 response_code = 204 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
41132024-09-23T23:19:20.825ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1993 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2d651be-7755-41bb-85ca-ca39b1baf36e uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-23T23:19:20.824906384Z }
41142024-09-23T23:19:20.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2d651be-7755-41bb-85ca-ca39b1baf36e roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
41152024-09-23T23:19:20.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2d651be-7755-41bb-85ca-ca39b1baf36e resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
41162024-09-23T23:19:20.836ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:56952
41172024-09-23T23:19:20.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:56952 req_id = 07e68fbe-a351-4e2d-8bfc-033d301d3a0b roles = RoleSet { roles: {} } uri = /metrics/producers
41182024-09-23T23:19:20.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:56952 req_id = 07e68fbe-a351-4e2d-8bfc-033d301d3a0b resource = Database result = Ok(()) uri = /metrics/producers
41192024-09-23T23:19:20.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 34394 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a2d651be-7755-41bb-85ca-ca39b1baf36e response_code = 204 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
41202024-09-23T23:19:20.869ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
41212024-09-23T23:19:20.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:56952 req_id = 07e68fbe-a351-4e2d-8bfc-033d301d3a0b roles = RoleSet { roles: {} } uri = /metrics/producers
41222024-09-23T23:19:20.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:56952 req_id = 07e68fbe-a351-4e2d-8bfc-033d301d3a0b resource = Database result = Ok(()) uri = /metrics/producers
41232024-09-23T23:19:20.875ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
41242024-09-23T23:19:20.876ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "40bc3966-0f78-46cb-91bc-78d5a46d5343", "date": "Mon, 23 Sep 2024 23:19:20 GMT"} })
41252024-09-23T23:19:20.876ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = cb582634-f7e6-465e-a57f-e77a51bf908d
41262024-09-23T23:19:20.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40465 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:56952 req_id = 07e68fbe-a351-4e2d-8bfc-033d301d3a0b response_code = 201 uri = /metrics/producers
41272024-09-23T23:19:20.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8eb68385-8f3a-4c85-b15f-ca8bf5ba647b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41282024-09-23T23:19:20.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8eb68385-8f3a-4c85-b15f-ca8bf5ba647b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41292024-09-23T23:19:20.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8eb68385-8f3a-4c85-b15f-ca8bf5ba647b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41302024-09-23T23:19:21.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3336cf82-097b-4011-b8e6-47f4ab60bb7f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41312024-09-23T23:19:21.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3336cf82-097b-4011-b8e6-47f4ab60bb7f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41322024-09-23T23:19:21.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3336cf82-097b-4011-b8e6-47f4ab60bb7f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41332024-09-23T23:19:22.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8046a93e-7e4a-4cad-883b-ccb64c7d8e85 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41342024-09-23T23:19:22.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8046a93e-7e4a-4cad-883b-ccb64c7d8e85 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41352024-09-23T23:19:22.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8046a93e-7e4a-4cad-883b-ccb64c7d8e85 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41362024-09-23T23:19:24.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 61d131a3-9f7b-430b-b1c4-28b08d67c39d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41372024-09-23T23:19:24.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 61d131a3-9f7b-430b-b1c4-28b08d67c39d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41382024-09-23T23:19:24.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 61d131a3-9f7b-430b-b1c4-28b08d67c39d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41392024-09-23T23:19:25.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 422ac9b5-b00e-4164-a976-94401db3ce7f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41402024-09-23T23:19:25.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 422ac9b5-b00e-4164-a976-94401db3ce7f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41412024-09-23T23:19:25.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 422ac9b5-b00e-4164-a976-94401db3ce7f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41422024-09-23T23:19:26.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9f77be93-0255-41b6-bc2a-1978a4d0c4c2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41432024-09-23T23:19:26.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9f77be93-0255-41b6-bc2a-1978a4d0c4c2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41442024-09-23T23:19:26.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9f77be93-0255-41b6-bc2a-1978a4d0c4c2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41452024-09-23T23:19:26.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1393 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 1d6022ec-4b9f-4ae5-8e7e-241a60a98c8e response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
41462024-09-23T23:19:27.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62abe01a-edb4-4428-8dce-2461b5641ca0 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41472024-09-23T23:19:27.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62abe01a-edb4-4428-8dce-2461b5641ca0 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41482024-09-23T23:19:27.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62abe01a-edb4-4428-8dce-2461b5641ca0 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41492024-09-23T23:19:27.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
41502024-09-23T23:19:27.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41512024-09-23T23:19:27.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41522024-09-23T23:19:27.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
41532024-09-23T23:19:27.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41542024-09-23T23:19:27.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41552024-09-23T23:19:27.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41562024-09-23T23:19:27.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41572024-09-23T23:19:27.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41582024-09-23T23:19:27.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41592024-09-23T23:19:27.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41602024-09-23T23:19:27.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41612024-09-23T23:19:27.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.449529ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41622024-09-23T23:19:27.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41632024-09-23T23:19:27.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41642024-09-23T23:19:27.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41652024-09-23T23:19:27.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
41662024-09-23T23:19:27.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41672024-09-23T23:19:27.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41682024-09-23T23:19:27.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
41692024-09-23T23:19:27.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.752043ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
41702024-09-23T23:19:28.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9791453a-54f8-4bb4-9eb6-5e78a12e78e4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41712024-09-23T23:19:28.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9791453a-54f8-4bb4-9eb6-5e78a12e78e4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41722024-09-23T23:19:28.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9791453a-54f8-4bb4-9eb6-5e78a12e78e4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41732024-09-23T23:19:29.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6261cda1-8cb2-4652-b41a-f1277a17a4ea roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41742024-09-23T23:19:29.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6261cda1-8cb2-4652-b41a-f1277a17a4ea resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41752024-09-23T23:19:29.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6261cda1-8cb2-4652-b41a-f1277a17a4ea response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41762024-09-23T23:19:30.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4ad73790-cd55-4c7a-934e-7952718b476a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41772024-09-23T23:19:30.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4ad73790-cd55-4c7a-934e-7952718b476a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41782024-09-23T23:19:30.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4ad73790-cd55-4c7a-934e-7952718b476a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41792024-09-23T23:19:31.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6b38a8a7-d642-4633-b07f-ca8e71d8ff62 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41802024-09-23T23:19:31.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6b38a8a7-d642-4633-b07f-ca8e71d8ff62 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41812024-09-23T23:19:31.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6b38a8a7-d642-4633-b07f-ca8e71d8ff62 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41822024-09-23T23:19:32.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = de9430de-83af-4698-8bb9-b3b3993fdc79 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41832024-09-23T23:19:32.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = de9430de-83af-4698-8bb9-b3b3993fdc79 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41842024-09-23T23:19:32.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = de9430de-83af-4698-8bb9-b3b3993fdc79 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41852024-09-23T23:19:33.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1ba5887a-cb01-445a-a544-c981f379c776 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41862024-09-23T23:19:33.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1ba5887a-cb01-445a-a544-c981f379c776 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41872024-09-23T23:19:33.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1ba5887a-cb01-445a-a544-c981f379c776 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41882024-09-23T23:19:34.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f2d26149-8eb3-4b63-bc24-d5fd98a55473 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41892024-09-23T23:19:34.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f2d26149-8eb3-4b63-bc24-d5fd98a55473 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41902024-09-23T23:19:34.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f2d26149-8eb3-4b63-bc24-d5fd98a55473 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41912024-09-23T23:19:35.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 93145709-befe-4e6b-8ef7-81f29ac1fb8b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41922024-09-23T23:19:35.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 93145709-befe-4e6b-8ef7-81f29ac1fb8b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41932024-09-23T23:19:35.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 93145709-befe-4e6b-8ef7-81f29ac1fb8b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41942024-09-23T23:19:36.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = c60c4d81-fb75-4f4b-b8a2-4285526a779c response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
41952024-09-23T23:19:36.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f821d774-957b-48dd-946d-09789445f91d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41962024-09-23T23:19:36.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f821d774-957b-48dd-946d-09789445f91d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41972024-09-23T23:19:36.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f821d774-957b-48dd-946d-09789445f91d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41982024-09-23T23:19:37.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 49444ce9-5813-498b-8d7b-3ad8c27e7c8f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
41992024-09-23T23:19:37.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 49444ce9-5813-498b-8d7b-3ad8c27e7c8f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
42002024-09-23T23:19:37.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 49444ce9-5813-498b-8d7b-3ad8c27e7c8f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
42012024-09-23T23:19:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
42022024-09-23T23:19:37.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
42032024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42042024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
42052024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42062024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
42072024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
42082024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42092024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42102024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
42112024-09-23T23:19:37.802ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-23 23:09:37.802011244 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42122024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42132024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
42142024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
42152024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
42162024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
42172024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42182024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42192024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42202024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42212024-09-23T23:19:37.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("954a3d10-a2dd-433b-9252-ede695863bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 687153151 } })
42222024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42232024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42242024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42252024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42262024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42272024-09-23T23:19:37.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65799211-2178-4ef6-a14b-629ea048347e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2729181-3180-4ecf-bd42-a48f1144b71d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 687375593 } })
42282024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
42292024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
42302024-09-23T23:19:37.802ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82
42312024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42322024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
42332024-09-23T23:19:37.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.651\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82"}
42342024-09-23T23:19:37.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42352024-09-23T23:19:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42362024-09-23T23:19:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42372024-09-23T23:19:37.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42382024-09-23T23:19:37.804ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
42392024-09-23T23:19:37.804ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
42402024-09-23T23:19:37.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.891333ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
42412024-09-23T23:19:37.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.871303ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
42422024-09-23T23:19:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42432024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
42442024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
42452024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42462024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42472024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
42482024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
42492024-09-23T23:19:37.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42502024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42512024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
42522024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42532024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
42542024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
42552024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42562024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42572024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42582024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
42592024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
42602024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42612024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42622024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
42632024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42642024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
42652024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42662024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42672024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
42682024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42692024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
42702024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42712024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
42722024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42732024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
42742024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42752024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42762024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42772024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42782024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42792024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42802024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42812024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42822024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42832024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42842024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42852024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42862024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42872024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42882024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42892024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42902024-09-23T23:19:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
42912024-09-23T23:19:37.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
42922024-09-23T23:19:37.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42932024-09-23T23:19:37.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42942024-09-23T23:19:37.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 690782262 } })
42952024-09-23T23:19:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42962024-09-23T23:19:37.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 691024535 } })
42972024-09-23T23:19:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42982024-09-23T23:19:37.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42992024-09-23T23:19:37.807ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-23 23:09:37.802011244 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43002024-09-23T23:19:37.807ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.328161ms iteration = 8 status = {"expiration":"2024-09-23T23:09:37.802011244Z","pruned":[]}
43012024-09-23T23:19:37.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
43022024-09-23T23:19:37.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
43032024-09-23T23:19:37.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43042024-09-23T23:19:37.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43052024-09-23T23:19:37.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43062024-09-23T23:19:37.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43072024-09-23T23:19:37.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43082024-09-23T23:19:37.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.460014ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43092024-09-23T23:19:37.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43102024-09-23T23:19:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43112024-09-23T23:19:37.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43122024-09-23T23:19:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43132024-09-23T23:19:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43142024-09-23T23:19:37.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.284054ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
43152024-09-23T23:19:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43162024-09-23T23:19:37.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43172024-09-23T23:19:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43182024-09-23T23:19:37.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43192024-09-23T23:19:37.815ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.027265ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
43202024-09-23T23:19:37.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43212024-09-23T23:19:37.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43222024-09-23T23:19:37.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43232024-09-23T23:19:37.829ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43242024-09-23T23:19:37.829ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43252024-09-23T23:19:37.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43262024-09-23T23:19:37.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43272024-09-23T23:19:37.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43282024-09-23T23:19:37.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43292024-09-23T23:19:37.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43302024-09-23T23:19:37.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43312024-09-23T23:19:37.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43322024-09-23T23:19:37.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43332024-09-23T23:19:37.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43342024-09-23T23:19:37.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43352024-09-23T23:19:37.845ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43362024-09-23T23:19:37.845ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43372024-09-23T23:19:37.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43382024-09-23T23:19:37.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43392024-09-23T23:19:37.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43402024-09-23T23:19:37.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
43412024-09-23T23:19:37.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43422024-09-23T23:19:37.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43432024-09-23T23:19:37.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43442024-09-23T23:19:37.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43452024-09-23T23:19:37.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43462024-09-23T23:19:37.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43472024-09-23T23:19:37.867ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43482024-09-23T23:19:37.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43492024-09-23T23:19:37.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43502024-09-23T23:19:37.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43512024-09-23T23:19:37.868ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43522024-09-23T23:19:37.868ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43532024-09-23T23:19:37.868ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.776265ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43542024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43552024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43562024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43572024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43582024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43592024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
43602024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
43612024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
43622024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43632024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43642024-09-23T23:19:37.869ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43652024-09-23T23:19:37.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43662024-09-23T23:19:37.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43672024-09-23T23:19:37.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43682024-09-23T23:19:37.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.564257ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43692024-09-23T23:19:37.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43702024-09-23T23:19:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43712024-09-23T23:19:37.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43722024-09-23T23:19:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43732024-09-23T23:19:37.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43742024-09-23T23:19:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43752024-09-23T23:19:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43762024-09-23T23:19:37.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43772024-09-23T23:19:37.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43782024-09-23T23:19:37.875ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
43792024-09-23T23:19:37.875ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
43802024-09-23T23:19:37.875ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.104578ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
43812024-09-23T23:19:37.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43822024-09-23T23:19:37.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43832024-09-23T23:19:37.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43842024-09-23T23:19:37.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43852024-09-23T23:19:37.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43862024-09-23T23:19:37.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43872024-09-23T23:19:37.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43882024-09-23T23:19:37.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43892024-09-23T23:19:37.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43902024-09-23T23:19:37.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.302255ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43912024-09-23T23:19:37.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
43922024-09-23T23:19:37.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.725445ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
43932024-09-23T23:19:37.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.931114ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
43942024-09-23T23:19:37.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43952024-09-23T23:19:37.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43962024-09-23T23:19:37.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43972024-09-23T23:19:37.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43982024-09-23T23:19:37.884ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 769377478 } })
43992024-09-23T23:19:37.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44002024-09-23T23:19:37.886ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
44012024-09-23T23:19:37.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44022024-09-23T23:19:37.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
44032024-09-23T23:19:37.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44042024-09-23T23:19:37.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44052024-09-23T23:19:37.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44062024-09-23T23:19:37.890ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44072024-09-23T23:19:37.890ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.438855ms iteration = 15 status = 0
44082024-09-23T23:19:37.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44092024-09-23T23:19:37.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44102024-09-23T23:19:37.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44112024-09-23T23:19:37.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44122024-09-23T23:19:37.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44132024-09-23T23:19:37.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44142024-09-23T23:19:37.898ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
44152024-09-23T23:19:37.899ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 93.791521ms iteration = 8 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
44162024-09-23T23:19:37.901ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.402761ms iteration = 18 status = {"physical_disks_added":0}
44172024-09-23T23:19:37.906ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44182024-09-23T23:19:37.906ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44192024-09-23T23:19:37.906ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44202024-09-23T23:19:37.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44212024-09-23T23:19:37.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44222024-09-23T23:19:37.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44232024-09-23T23:19:37.909ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44242024-09-23T23:19:37.909ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44252024-09-23T23:19:37.909ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.577335ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44262024-09-23T23:19:37.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44272024-09-23T23:19:37.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44282024-09-23T23:19:37.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44292024-09-23T23:19:37.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.576942ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44302024-09-23T23:19:37.919ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44312024-09-23T23:19:37.919ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44322024-09-23T23:19:37.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44332024-09-23T23:19:37.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44342024-09-23T23:19:37.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 114.920075ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44352024-09-23T23:19:37.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-09-23T23:19:37.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44372024-09-23T23:19:37.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44382024-09-23T23:19:37.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44392024-09-23T23:19:37.927ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44402024-09-23T23:19:37.927ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
44412024-09-23T23:19:37.927ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44422024-09-23T23:19:37.927ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-23 23:12:39.428682 UTC dns_group = internal generation = 1
44432024-09-23T23:19:37.927ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 125.7516ms iteration = 9 status = {"generation":1}
44442024-09-23T23:19:37.929ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
44452024-09-23T23:19:37.929ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44462024-09-23T23:19:37.929ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "703a1e92-34f5-4c3a-9737-c86ca329f24b", "content-length": "26", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} })
44472024-09-23T23:19:37.929ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44482024-09-23T23:19:37.932ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44492024-09-23T23:19:37.936ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44502024-09-23T23:19:37.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44512024-09-23T23:19:37.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44522024-09-23T23:19:37.939ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44532024-09-23T23:19:37.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44542024-09-23T23:19:37.942ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44552024-09-23T23:19:37.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44562024-09-23T23:19:37.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
44572024-09-23T23:19:37.961ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44582024-09-23T23:19:37.962ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "09eb3b44-f0ff-4269-90ab-a4777d02011e", "content-length": "26", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} })
44592024-09-23T23:19:37.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44602024-09-23T23:19:37.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44612024-09-23T23:19:37.966ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44622024-09-23T23:19:37.966ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 0 version = 2
44632024-09-23T23:19:37.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44642024-09-23T23:19:37.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44652024-09-23T23:19:37.968ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44662024-09-23T23:19:37.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44672024-09-23T23:19:37.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44682024-09-23T23:19:37.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44692024-09-23T23:19:37.976ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 1 version = 2
44702024-09-23T23:19:37.976ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
44712024-09-23T23:19:37.976ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-23 23:12:40.294485 UTC dns_group = external generation = 2
44722024-09-23T23:19:37.976ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 174.32361ms iteration = 9 status = {"generation":2}
44732024-09-23T23:19:37.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44742024-09-23T23:19:37.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44752024-09-23T23:19:38.010ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-23T23:12:36.221760Z, time_modified: 2024-09-23T23:12:36.221760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
44762024-09-23T23:19:38.010ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 208.689915ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]}},"default_endpoint":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44772024-09-23T23:19:38.046ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
44782024-09-23T23:19:38.046ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44792024-09-23T23:19:38.048ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "44a1f5ce-7311-4df9-ac89-39acd1ac9e36", "content-length": "26", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} })
44802024-09-23T23:19:38.048ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44812024-09-23T23:19:38.049ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
44822024-09-23T23:19:38.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44832024-09-23T23:19:38.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44842024-09-23T23:19:38.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44852024-09-23T23:19:38.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44862024-09-23T23:19:38.111ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44872024-09-23T23:19:38.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44882024-09-23T23:19:38.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44892024-09-23T23:19:38.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44902024-09-23T23:19:38.115ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44912024-09-23T23:19:38.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44922024-09-23T23:19:38.158ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878/state
44932024-09-23T23:19:38.159ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "283f1c46-aec7-4183-853e-1372fbb732da", "content-length": "130", "date": "Mon, 23 Sep 2024 23:19:38 GMT"} })
44942024-09-23T23:19:38.164ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-23T23:19:20.824906384Z }, migration_in: None, migration_out: None } vmm_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
44952024-09-23T23:19:38.164ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1993 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d vmm_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-23T23:19:20.824906384Z }
44962024-09-23T23:19:38.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d roles = RoleSet { roles: {} } sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d vmm_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
44972024-09-23T23:19:38.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d resource = Database result = Ok(()) sled_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d vmm_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878
44982024-09-23T23:19:38.169ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44992024-09-23T23:19:38.171ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45002024-09-23T23:19:38.173ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "83dde3ba-3829-41bf-9975-d9958a6b086b", "date": "Mon, 23 Sep 2024 23:19:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45012024-09-23T23:19:38.173ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45022024-09-23T23:19:38.177ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c01249d3-0a08-47d5-9954-1985f4a299cb", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45032024-09-23T23:19:38.177ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45042024-09-23T23:19:38.180ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45052024-09-23T23:19:38.180ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 378.602323ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45062024-09-23T23:19:38.222ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45072024-09-23T23:19:38.222ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "88c129bc-3262-4d51-a74f-dd98e2afddcb", "content-length": "525", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} })
45082024-09-23T23:19:38.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45092024-09-23T23:19:38.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45102024-09-23T23:19:38.240ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 438.300731ms iteration = 15 status = {}
45112024-09-23T23:19:38.270ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45122024-09-23T23:19:38.270ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "17cb7c40-ee0d-425a-89f3-0cec88dfc988", "content-length": "1", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} })
45132024-09-23T23:19:38.272ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45142024-09-23T23:19:38.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45152024-09-23T23:19:38.278ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45162024-09-23T23:19:38.279ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2800bee3-d5d7-48a6-9d27-d39715bfd551", "content-length": "811", "date": "Mon, 23 Sep 2024 23:19:38 GMT"} })
45172024-09-23T23:19:38.279ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(13450302) }} sled = sock
45182024-09-23T23:19:38.279ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45192024-09-23T23:19:38.279ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45202024-09-23T23:19:38.281ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 476.005726ms iteration = 15 status = {}
45212024-09-23T23:19:38.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45222024-09-23T23:19:38.281ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 479.679128ms iteration = 15 status = null
45232024-09-23T23:19:38.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45242024-09-23T23:19:38.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45252024-09-23T23:19:38.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45262024-09-23T23:19:38.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45272024-09-23T23:19:38.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45282024-09-23T23:19:38.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45292024-09-23T23:19:38.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45302024-09-23T23:19:38.291ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45312024-09-23T23:19:38.292ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "11a78c78-66cd-4fda-a06c-9cda5721cbda", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45322024-09-23T23:19:38.292ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45332024-09-23T23:19:38.293ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7c32cf1a-83e6-4379-98bf-e425a90aa38f", "date": "Mon, 23 Sep 2024 23:19:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45342024-09-23T23:19:38.293ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45352024-09-23T23:19:38.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45362024-09-23T23:19:38.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45372024-09-23T23:19:38.296ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7d8e46a2-a73a-42b4-9ae6-10d365c5d991", "date": "Mon, 23 Sep 2024 23:19:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45382024-09-23T23:19:38.296ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45392024-09-23T23:19:38.298ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45402024-09-23T23:19:38.298ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 496.473642ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45412024-09-23T23:19:38.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45422024-09-23T23:19:38.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45432024-09-23T23:19:38.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45442024-09-23T23:19:38.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45452024-09-23T23:19:38.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45462024-09-23T23:19:38.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45472024-09-23T23:19:38.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45482024-09-23T23:19:38.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45492024-09-23T23:19:38.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45502024-09-23T23:19:38.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45512024-09-23T23:19:38.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45522024-09-23T23:19:38.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45532024-09-23T23:19:38.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45542024-09-23T23:19:38.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45552024-09-23T23:19:38.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45562024-09-23T23:19:38.313ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
45572024-09-23T23:19:38.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, lookup_type: ById(991d1ba4-4b68-4c37-85c3-fa3cf0f320b6) }, key: 09bf8117-7ca7-4472-a419-33af09f3ce6d, lookup_type: ById(09bf8117-7ca7-4472-a419-33af09f3ce6d) }, key: 4485cb28-c4fe-496a-98d4-ccc1a0b4e109, lookup_type: ById(4485cb28-c4fe-496a-98d4-ccc1a0b4e109) }, key: f4f41eaf-6ac5-4a9d-8ee7-e9fb691506b3, lookup_type: ById(f4f41eaf-6ac5-4a9d-8ee7-e9fb691506b3) } result = Ok(())
45582024-09-23T23:19:38.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45592024-09-23T23:19:38.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45602024-09-23T23:19:38.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45612024-09-23T23:19:38.315ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 510.091219ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
45622024-09-23T23:19:38.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45632024-09-23T23:19:38.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45642024-09-23T23:19:38.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45652024-09-23T23:19:38.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45662024-09-23T23:19:38.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, lookup_type: ById(991d1ba4-4b68-4c37-85c3-fa3cf0f320b6) }, key: 09bf8117-7ca7-4472-a419-33af09f3ce6d, lookup_type: ById(09bf8117-7ca7-4472-a419-33af09f3ce6d) }, key: 4485cb28-c4fe-496a-98d4-ccc1a0b4e109, lookup_type: ById(4485cb28-c4fe-496a-98d4-ccc1a0b4e109) }, key: f4f41eaf-6ac5-4a9d-8ee7-e9fb691506b3, lookup_type: ById(f4f41eaf-6ac5-4a9d-8ee7-e9fb691506b3) } result = Ok(())
45672024-09-23T23:19:38.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45682024-09-23T23:19:38.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45692024-09-23T23:19:38.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45702024-09-23T23:19:38.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45712024-09-23T23:19:38.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45722024-09-23T23:19:38.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45732024-09-23T23:19:38.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45742024-09-23T23:19:38.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 389fae29-ef18-4b11-8b36-df751c8dcfc7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
45752024-09-23T23:19:38.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 389fae29-ef18-4b11-8b36-df751c8dcfc7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
45762024-09-23T23:19:38.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45772024-09-23T23:19:38.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 389fae29-ef18-4b11-8b36-df751c8dcfc7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
45782024-09-23T23:19:38.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45792024-09-23T23:19:38.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45802024-09-23T23:19:38.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45812024-09-23T23:19:38.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45822024-09-23T23:19:38.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45832024-09-23T23:19:38.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45842024-09-23T23:19:38.332ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
45852024-09-23T23:19:38.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45862024-09-23T23:19:38.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45872024-09-23T23:19:38.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45882024-09-23T23:19:38.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45892024-09-23T23:19:38.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45902024-09-23T23:19:38.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45912024-09-23T23:19:38.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45922024-09-23T23:19:38.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, lookup_type: ById(991d1ba4-4b68-4c37-85c3-fa3cf0f320b6) }, key: 09bf8117-7ca7-4472-a419-33af09f3ce6d, lookup_type: ById(09bf8117-7ca7-4472-a419-33af09f3ce6d) }, key: 4485cb28-c4fe-496a-98d4-ccc1a0b4e109, lookup_type: ById(4485cb28-c4fe-496a-98d4-ccc1a0b4e109) }, key: 92aec132-ffe6-4b99-b03b-ed7109d0bdcd, lookup_type: ByName("default") } result = Ok(())
45932024-09-23T23:19:38.341ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45942024-09-23T23:19:38.342ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d108fc30-d414-46b1-a336-91161484faf2", "date": "Mon, 23 Sep 2024 23:19:38 GMT"} })
45952024-09-23T23:19:38.343ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 538.551407ms iteration = 16 status = {}
45962024-09-23T23:19:38.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45972024-09-23T23:19:38.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c8589cc6-f6cf-438e-aefe-312b1188ff6e", "content-length": "121", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} })
45982024-09-23T23:19:38.345ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
45992024-09-23T23:19:38.345ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
46002024-09-23T23:19:38.345ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46012024-09-23T23:19:38.345ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46022024-09-23T23:19:38.345ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
46032024-09-23T23:19:38.345ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
46042024-09-23T23:19:38.345ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
46052024-09-23T23:19:38.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46062024-09-23T23:19:38.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46072024-09-23T23:19:38.347ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46082024-09-23T23:19:38.347ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c79685d5-009e-404c-8945-34ec6cad25f0", "content-length": "2", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} })
46092024-09-23T23:19:38.347ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46102024-09-23T23:19:38.348ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e81b9aa0-d974-4433-8257-b861488c9ad2", "content-length": "52", "date": "Mon, 23 Sep 2024 23:19:37 GMT"} })
46112024-09-23T23:19:38.348ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
46122024-09-23T23:19:38.348ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46132024-09-23T23:19:38.448ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "74018e88-54d7-4eca-8b07-c923aa5f9504", "date": "Mon, 23 Sep 2024 23:19:38 GMT"} })
46142024-09-23T23:19:38.448ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
46152024-09-23T23:19:38.448ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46162024-09-23T23:19:38.449ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f1ee4b45-dede-4418-b707-0d528c6ae390", "content-length": "667", "date": "Mon, 23 Sep 2024 23:19:38 GMT"} })
46172024-09-23T23:19:38.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46182024-09-23T23:19:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46192024-09-23T23:19:38.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46202024-09-23T23:19:38.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46212024-09-23T23:19:38.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46222024-09-23T23:19:38.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46232024-09-23T23:19:38.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46242024-09-23T23:19:38.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46252024-09-23T23:19:38.466ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 661.19243ms iteration = 15 status = {}
46262024-09-23T23:19:39.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8bc02e80-55ef-4ca1-8fd3-e722f3a9a939 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46272024-09-23T23:19:39.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8bc02e80-55ef-4ca1-8fd3-e722f3a9a939 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46282024-09-23T23:19:39.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8bc02e80-55ef-4ca1-8fd3-e722f3a9a939 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46292024-09-23T23:19:40.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 43e3b621-e0e2-4257-8e5e-95d67a0e8a1d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46302024-09-23T23:19:40.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 43e3b621-e0e2-4257-8e5e-95d67a0e8a1d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46312024-09-23T23:19:40.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 43e3b621-e0e2-4257-8e5e-95d67a0e8a1d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46322024-09-23T23:19:41.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 799734ac-79aa-4a18-b846-037b95f50bcd roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46332024-09-23T23:19:41.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 799734ac-79aa-4a18-b846-037b95f50bcd resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46342024-09-23T23:19:41.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 799734ac-79aa-4a18-b846-037b95f50bcd response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46352024-09-23T23:19:42.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e10b86b-1702-4ac9-b7d7-c1707c9aa7b0 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46362024-09-23T23:19:42.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e10b86b-1702-4ac9-b7d7-c1707c9aa7b0 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46372024-09-23T23:19:42.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e10b86b-1702-4ac9-b7d7-c1707c9aa7b0 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46382024-09-23T23:19:42.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 6833e5f8-4aa4-413f-828c-d7bbee48b3e2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
46392024-09-23T23:19:42.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 6833e5f8-4aa4-413f-828c-d7bbee48b3e2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
46402024-09-23T23:19:42.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 6833e5f8-4aa4-413f-828c-d7bbee48b3e2 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
46412024-09-23T23:19:43.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9254b326-7696-4b58-8c95-0d186dfced61 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46422024-09-23T23:19:43.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9254b326-7696-4b58-8c95-0d186dfced61 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46432024-09-23T23:19:43.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9254b326-7696-4b58-8c95-0d186dfced61 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46442024-09-23T23:19:44.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 59a4663e-a9d0-462b-9b4d-afd622bc3d32 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46452024-09-23T23:19:44.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 59a4663e-a9d0-462b-9b4d-afd622bc3d32 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46462024-09-23T23:19:44.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 59a4663e-a9d0-462b-9b4d-afd622bc3d32 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46472024-09-23T23:19:45.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41b05117-cdaf-4548-8d0d-286b02068a3f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46482024-09-23T23:19:45.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41b05117-cdaf-4548-8d0d-286b02068a3f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46492024-09-23T23:19:45.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41b05117-cdaf-4548-8d0d-286b02068a3f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46502024-09-23T23:19:46.181ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 520028ae-eafe-4c10-b313-6d3413781f38 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
46512024-09-23T23:19:46.432ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1993 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f233d2a1-c02b-41b8-84a1-9006448cf102 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-23T23:19:46.431765571Z }
46522024-09-23T23:19:46.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f233d2a1-c02b-41b8-84a1-9006448cf102 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
46532024-09-23T23:19:46.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f233d2a1-c02b-41b8-84a1-9006448cf102 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
46542024-09-23T23:19:46.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 10898 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f233d2a1-c02b-41b8-84a1-9006448cf102 response_code = 204 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
46552024-09-23T23:19:46.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 51c0602f-d504-4f80-afb6-768e368ddde6 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46562024-09-23T23:19:46.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 51c0602f-d504-4f80-afb6-768e368ddde6 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46572024-09-23T23:19:46.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 51c0602f-d504-4f80-afb6-768e368ddde6 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46582024-09-23T23:19:47.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 05f2659b-0b9d-44f2-9070-7b483934747e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46592024-09-23T23:19:47.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 05f2659b-0b9d-44f2-9070-7b483934747e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46602024-09-23T23:19:47.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 05f2659b-0b9d-44f2-9070-7b483934747e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46612024-09-23T23:19:47.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 712926fe-b620-4f5a-83e3-75d281f79f41 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
46622024-09-23T23:19:47.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 712926fe-b620-4f5a-83e3-75d281f79f41 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
46632024-09-23T23:19:47.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 712926fe-b620-4f5a-83e3-75d281f79f41 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
46642024-09-23T23:19:47.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 98b59008-9a5f-40bf-b990-7d1f7a49a0a5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
46652024-09-23T23:19:47.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 98b59008-9a5f-40bf-b990-7d1f7a49a0a5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
46662024-09-23T23:19:47.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 98b59008-9a5f-40bf-b990-7d1f7a49a0a5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
46672024-09-23T23:19:47.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
46682024-09-23T23:19:47.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46692024-09-23T23:19:47.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46702024-09-23T23:19:47.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46712024-09-23T23:19:47.804ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
46722024-09-23T23:19:47.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46732024-09-23T23:19:47.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46742024-09-23T23:19:47.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46752024-09-23T23:19:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46762024-09-23T23:19:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46772024-09-23T23:19:47.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46782024-09-23T23:19:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46792024-09-23T23:19:47.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46802024-09-23T23:19:47.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46812024-09-23T23:19:47.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822024-09-23T23:19:47.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
46832024-09-23T23:19:47.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46842024-09-23T23:19:47.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46852024-09-23T23:19:47.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
46862024-09-23T23:19:47.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.575311ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
46872024-09-23T23:19:47.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.864278ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46882024-09-23T23:19:48.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 474ea4b5-9f51-488a-8649-1fd9d4111c88 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46892024-09-23T23:19:48.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 474ea4b5-9f51-488a-8649-1fd9d4111c88 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46902024-09-23T23:19:48.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 474ea4b5-9f51-488a-8649-1fd9d4111c88 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
46912024-09-23T23:19:48.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 132b3004-0e37-4e55-a0d2-856371edb732 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
46922024-09-23T23:19:48.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 132b3004-0e37-4e55-a0d2-856371edb732 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
46932024-09-23T23:19:48.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 132b3004-0e37-4e55-a0d2-856371edb732 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
46942024-09-23T23:19:48.862ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1993 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-23T23:19:48.861767136Z }
46952024-09-23T23:19:48.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
46962024-09-23T23:19:48.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
46972024-09-23T23:19:48.895ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878 vmm_needs_update = true
46982024-09-23T23:19:48.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
46992024-09-23T23:19:48.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47002024-09-23T23:19:48.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47012024-09-23T23:19:48.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47022024-09-23T23:19:48.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47032024-09-23T23:19:48.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47042024-09-23T23:19:48.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47052024-09-23T23:19:48.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47062024-09-23T23:19:48.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47072024-09-23T23:19:48.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47082024-09-23T23:19:48.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47092024-09-23T23:19:48.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47102024-09-23T23:19:48.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47112024-09-23T23:19:48.912ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, lookup_type: ById(991d1ba4-4b68-4c37-85c3-fa3cf0f320b6) }, key: 09bf8117-7ca7-4472-a419-33af09f3ce6d, lookup_type: ById(09bf8117-7ca7-4472-a419-33af09f3ce6d) }, key: cb582634-f7e6-465e-a57f-e77a51bf908d, lookup_type: ById(cb582634-f7e6-465e-a57f-e77a51bf908d) } result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47122024-09-23T23:19:48.912ZINFOnexus (dropshot_internal): starting update saga for cb582634-f7e6-465e-a57f-e77a51bf908d actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1468 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-23T23:19:48.861767136Z }
47132024-09-23T23:19:48.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50275 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 response_code = 204 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47142024-09-23T23:19:48.912ZDEBGnexus (dropshot_internal): preparing instance-update saga for cb582634-f7e6-465e-a57f-e77a51bf908d... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 281ac200-e6d6-4c05-9777-e1af32489c82 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47152024-09-23T23:19:48.912ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update
47162024-09-23T23:19:48.912ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"cb582634-f7e6-465e-a57f-e77a51bf908d","lookup_type":{"ById":"cb582634-f7e6-465e-a57f-e77a51bf908d"},"parent":{"key":"09bf8117-7ca7-4472-a419-33af09f3ce6d","lookup_type":{"ById":"09bf8117-7ca7-4472-a419-33af09f3ce6d"},"parent":{"key":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","lookup_type":{"ById":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47172024-09-23T23:19:48.912ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update
47182024-09-23T23:19:48.912ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1993 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5963e75e-e87f-4942-a2db-f518f4fa3ae7 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-23T23:19:48.861767136Z }
47192024-09-23T23:19:48.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5963e75e-e87f-4942-a2db-f518f4fa3ae7 roles = RoleSet { roles: {} } uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47202024-09-23T23:19:48.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5963e75e-e87f-4942-a2db-f518f4fa3ae7 resource = Database result = Ok(()) uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47212024-09-23T23:19:48.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5300 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5963e75e-e87f-4942-a2db-f518f4fa3ae7 response_code = 204 uri = /vmms/07232b9b-c6d0-4bc1-b45b-a94bf46ac878
47222024-09-23T23:19:48.941ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update
47232024-09-23T23:19:48.941ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47242024-09-23T23:19:48.941ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47252024-09-23T23:19:48.941ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
47262024-09-23T23:19:48.946ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47272024-09-23T23:19:48.946ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
47282024-09-23T23:19:48.950ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47292024-09-23T23:19:48.950ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
47302024-09-23T23:19:48.953ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47312024-09-23T23:19:48.953ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("7877fbef-3172-4877-b5d9-63c5da16ec80")) node_id = 0 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
47322024-09-23T23:19:48.957ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47332024-09-23T23:19:48.957ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
47342024-09-23T23:19:48.962ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update
47352024-09-23T23:19:48.962ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47362024-09-23T23:19:48.962ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47372024-09-23T23:19:48.964ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47382024-09-23T23:19:48.964ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47392024-09-23T23:19:48.965ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47402024-09-23T23:19:48.965ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47412024-09-23T23:19:48.967ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47422024-09-23T23:19:48.967ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47432024-09-23T23:19:48.968ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47442024-09-23T23:19:48.968ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47452024-09-23T23:19:48.970ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47462024-09-23T23:19:48.970ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47472024-09-23T23:19:48.971ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47482024-09-23T23:19:48.974ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, lookup_type: ById(991d1ba4-4b68-4c37-85c3-fa3cf0f320b6) }, key: 09bf8117-7ca7-4472-a419-33af09f3ce6d, lookup_type: ById(09bf8117-7ca7-4472-a419-33af09f3ce6d) }, key: cb582634-f7e6-465e-a57f-e77a51bf908d, lookup_type: ById(cb582634-f7e6-465e-a57f-e77a51bf908d) } result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47492024-09-23T23:19:48.974ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance updater_id = 7877fbef-3172-4877-b5d9-63c5da16ec80
47502024-09-23T23:19:48.974ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47512024-09-23T23:19:48.974ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47522024-09-23T23:19:48.990ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance updater_id = 7877fbef-3172-4877-b5d9-63c5da16ec80
47532024-09-23T23:19:48.990ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47542024-09-23T23:19:48.990ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance
47552024-09-23T23:19:48.994ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d locked_gen = Generation(Generation(2)) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = LockInstance updater_id = 7877fbef-3172-4877-b5d9-63c5da16ec80
47562024-09-23T23:19:48.994ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47572024-09-23T23:19:48.994ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("7877fbef-3172-4877-b5d9-63c5da16ec80")}) node_id = 1 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
47582024-09-23T23:19:48.997ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47592024-09-23T23:19:48.997ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
47602024-09-23T23:19:49.008ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47612024-09-23T23:19:49.008ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47622024-09-23T23:19:49.009ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47632024-09-23T23:19:49.010ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47642024-09-23T23:19:49.010ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47652024-09-23T23:19:49.011ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47662024-09-23T23:19:49.012ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47672024-09-23T23:19:49.015ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, lookup_type: ById(991d1ba4-4b68-4c37-85c3-fa3cf0f320b6) }, key: 09bf8117-7ca7-4472-a419-33af09f3ce6d, lookup_type: ById(09bf8117-7ca7-4472-a419-33af09f3ce6d) }, key: cb582634-f7e6-465e-a57f-e77a51bf908d, lookup_type: ById(cb582634-f7e6-465e-a57f-e77a51bf908d) } result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47682024-09-23T23:19:49.015ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47692024-09-23T23:19:49.015ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
47702024-09-23T23:19:49.025ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 07232b9b-c6d0-4bc1-b45b-a94bf46ac878, time_created: 2024-09-23T23:19:12.212645Z, time_deleted: None, instance_id: cb582634-f7e6-465e-a57f-e77a51bf908d, sled_id: a6cfeab5-1bcd-4180-8b80-d27bd607042d, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-09-23T23:19:48.861767Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-09-23T23:19:10.002673Z, gen: Generation(Generation(3)), propolis_id: Some(07232b9b-c6d0-4bc1-b45b-a94bf46ac878), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(07232b9b-c6d0-4bc1-b45b-a94bf46ac878 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-09-23T23:19:49.023226967Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
47712024-09-23T23:19:49.026ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
47722024-09-23T23:19:49.026ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"cb582634-f7e6-465e-a57f-e77a51bf908d","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"07232b9b-c6d0-4bc1-b45b-a94bf46ac878"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"cb582634-f7e6-465e-a57f-e77a51bf908d","lookup_type":{"ById":"cb582634-f7e6-465e-a57f-e77a51bf908d"},"parent":{"key":"09bf8117-7ca7-4472-a419-33af09f3ce6d","lookup_type":{"ById":"09bf8117-7ca7-4472-a419-33af09f3ce6d"},"parent":{"key":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","lookup_type":{"ById":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"7877fbef-3172-4877-b5d9-63c5da16ec80"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"09bf8117-7ca7-4472-a419-33af09f3ce6d","ram_diff":1073741824},"destroy_active_vmm":"07232b9b-c6d0-4bc1-b45b-a94bf46ac878","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-09-23T23:19:49.023226967Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47732024-09-23T23:19:49.026ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
47742024-09-23T23:19:49.055ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
47752024-09-23T23:19:49.055ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47762024-09-23T23:19:49.055ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47772024-09-23T23:19:49.055ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
47782024-09-23T23:19:49.059ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47792024-09-23T23:19:49.059ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
47802024-09-23T23:19:49.063ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47812024-09-23T23:19:49.063ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
47822024-09-23T23:19:49.066ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47832024-09-23T23:19:49.066ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("9b81cc52-b0a7-4bbf-8759-bcae0c243995")) node_id = 0 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
47842024-09-23T23:19:49.069ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47852024-09-23T23:19:49.069ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
47862024-09-23T23:19:49.076ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d parent_lock = UpdaterLock { updater_id: 7877fbef-3172-4877-b5d9-63c5da16ec80, locked_gen: Generation(Generation(2)) } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
47872024-09-23T23:19:49.076ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = BecomeUpdater
47882024-09-23T23:19:49.077ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = BecomeUpdater
47892024-09-23T23:19:49.085ZDEBGnexus (SagaExecutor): inherited lock from 7877fbef-3172-4877-b5d9-63c5da16ec80 to 9b81cc52-b0a7-4bbf-8759-bcae0c243995 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 7877fbef-3172-4877-b5d9-63c5da16ec80 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = BecomeUpdater updater_id = 9b81cc52-b0a7-4bbf-8759-bcae0c243995
47902024-09-23T23:19:49.085ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:965 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
47912024-09-23T23:19:49.085ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47922024-09-23T23:19:49.085ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("9b81cc52-b0a7-4bbf-8759-bcae0c243995")}) node_id = 1 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
47932024-09-23T23:19:49.088ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47942024-09-23T23:19:49.088ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
47952024-09-23T23:19:49.092ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47962024-09-23T23:19:49.092ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
47972024-09-23T23:19:49.095ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
47982024-09-23T23:19:49.095ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
47992024-09-23T23:19:49.097ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1018 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48002024-09-23T23:19:49.102ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d
48012024-09-23T23:19:49.102ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UpdateNetworkConfig
48022024-09-23T23:19:49.103ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UpdateNetworkConfig
48032024-09-23T23:19:49.108ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UpdateNetworkConfig
48042024-09-23T23:19:49.108ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UpdateNetworkConfig
48052024-09-23T23:19:49.114ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
48062024-09-23T23:19:49.114ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UpdateNetworkConfig
48072024-09-23T23:19:49.114ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UpdateNetworkConfig
48082024-09-23T23:19:49.116ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
48092024-09-23T23:19:49.116ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
48102024-09-23T23:19:49.116ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
48112024-09-23T23:19:49.117ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
48122024-09-23T23:19:49.118ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
48132024-09-23T23:19:49.118ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
48142024-09-23T23:19:49.118ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
48152024-09-23T23:19:49.122ZDEBGnexus: notifying dendrite of updates instance_id = Some(cb582634-f7e6-465e-a57f-e77a51bf908d (instance)) switch = switch0
48162024-09-23T23:19:49.123ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1389, tv_nsec: 7980312 } })
48172024-09-23T23:19:49.124ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1051
48182024-09-23T23:19:49.154ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
48192024-09-23T23:19:49.154ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48202024-09-23T23:19:49.154ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "405ba078-62bb-4e41-8264-81a23f499dcd", "content-length": "26", "date": "Mon, 23 Sep 2024 23:19:48 GMT"} })
48212024-09-23T23:19:49.154ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48222024-09-23T23:19:49.155ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48232024-09-23T23:19:49.184ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
48242024-09-23T23:19:49.184ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dbe52af6-5844-4dc4-814c-d63422ef426c", "content-length": "4", "date": "Mon, 23 Sep 2024 23:19:49 GMT"} })
48252024-09-23T23:19:49.186ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48262024-09-23T23:19:49.186ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48272024-09-23T23:19:49.189ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48282024-09-23T23:19:49.189ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48292024-09-23T23:19:49.192ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
48302024-09-23T23:19:49.193ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
48312024-09-23T23:19:49.203ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1093 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-09-23T23:19:49.195448Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 09bf8117-7ca7-4472-a419-33af09f3ce6d, time_modified: Some(2024-09-23T23:19:49.195448Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, time_modified: Some(2024-09-23T23:19:49.195448Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48322024-09-23T23:19:49.203ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48332024-09-23T23:19:49.203ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48342024-09-23T23:19:49.207ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48352024-09-23T23:19:49.207ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48362024-09-23T23:19:49.212ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1128 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48372024-09-23T23:19:49.212ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UnassignOximeterProducer
48382024-09-23T23:19:49.212ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UnassignOximeterProducer
48392024-09-23T23:19:49.217ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d producer_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48402024-09-23T23:19:49.217ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UnassignOximeterProducer
48412024-09-23T23:19:49.217ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = UnassignOximeterProducer
48422024-09-23T23:19:49.255ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48432024-09-23T23:19:49.255ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/cb582634-f7e6-465e-a57f-e77a51bf908d
48442024-09-23T23:19:49.259ZDEBGnexus (SagaExecutor): client response oximeter-collector = cb582634-f7e6-465e-a57f-e77a51bf908d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/cb582634-f7e6-465e-a57f-e77a51bf908d", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1171176c-6acb-48ed-82ab-df422f794268", "date": "Mon, 23 Sep 2024 23:19:49 GMT"} }) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48452024-09-23T23:19:49.259ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d producer_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48462024-09-23T23:19:49.260ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48472024-09-23T23:19:49.260ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48482024-09-23T23:19:49.264ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48492024-09-23T23:19:49.264ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48502024-09-23T23:19:49.267ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d lock = UpdaterLock { updater_id: 9b81cc52-b0a7-4bbf-8759-bcae0c243995, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-09-23T23:19:49.023226967Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48512024-09-23T23:19:49.267ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = CommitInstanceUpdates
48522024-09-23T23:19:49.268ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = CommitInstanceUpdates
48532024-09-23T23:19:49.302ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1177 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d new_runtime = InstanceRuntimeState { time_updated: 2024-09-23T23:19:49.023226967Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48542024-09-23T23:19:49.302ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48552024-09-23T23:19:49.302ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48562024-09-23T23:19:49.302ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Signaled
48572024-09-23T23:19:49.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48582024-09-23T23:19:49.302ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Signaled
48592024-09-23T23:19:49.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48602024-09-23T23:19:49.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48612024-09-23T23:19:49.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48622024-09-23T23:19:49.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48632024-09-23T23:19:49.306ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48642024-09-23T23:19:49.306ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48652024-09-23T23:19:49.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48662024-09-23T23:19:49.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48672024-09-23T23:19:49.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48682024-09-23T23:19:49.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48692024-09-23T23:19:49.309ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48702024-09-23T23:19:49.309ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("cb582634-f7e6-465e-a57f-e77a51bf908d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("07232b9b-c6d0-4bc1-b45b-a94bf46ac878")}) node_id = 7 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48712024-09-23T23:19:49.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48722024-09-23T23:19:49.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48732024-09-23T23:19:49.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48742024-09-23T23:19:49.313ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48752024-09-23T23:19:49.313ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48762024-09-23T23:19:49.316ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48772024-09-23T23:19:49.316ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48782024-09-23T23:19:49.319ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48792024-09-23T23:19:49.319ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48802024-09-23T23:19:49.323ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48812024-09-23T23:19:49.323ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ReleaseSledResources
48822024-09-23T23:19:49.323ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ReleaseSledResources
48832024-09-23T23:19:49.336ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48842024-09-23T23:19:49.336ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48852024-09-23T23:19:49.339ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48862024-09-23T23:19:49.339ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48872024-09-23T23:19:49.342ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d propolis_id = 07232b9b-c6d0-4bc1-b45b-a94bf46ac878 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
48882024-09-23T23:19:49.342ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = MarkVmmDeleted
48892024-09-23T23:19:49.342ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = MarkVmmDeleted
48902024-09-23T23:19:49.351ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48912024-09-23T23:19:49.351ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48922024-09-23T23:19:49.354ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48932024-09-23T23:19:49.354ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48942024-09-23T23:19:49.361ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48952024-09-23T23:19:49.361ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48962024-09-23T23:19:49.364ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
48972024-09-23T23:19:49.364ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
48982024-09-23T23:19:49.368ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
48992024-09-23T23:19:49.368ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
49002024-09-23T23:19:49.394ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
49012024-09-23T23:19:49.395ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
49022024-09-23T23:19:49.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49032024-09-23T23:19:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49042024-09-23T23:19:49.398ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49052024-09-23T23:19:49.398ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "40122bfa-6774-46a3-8628-c21ba8a39245", "content-length": "372", "date": "Mon, 23 Sep 2024 23:19:49 GMT"} })
49062024-09-23T23:19:49.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49072024-09-23T23:19:49.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49082024-09-23T23:19:49.400ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
49092024-09-23T23:19:49.400ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
49102024-09-23T23:19:49.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49112024-09-23T23:19:49.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49122024-09-23T23:19:49.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49132024-09-23T23:19:49.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49142024-09-23T23:19:49.412ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49152024-09-23T23:19:49.412ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "07173201-4698-4063-ab0f-dc9fe63c42f6", "date": "Mon, 23 Sep 2024 23:19:49 GMT"} })
49162024-09-23T23:19:49.414ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 111.954381ms iteration = 17 status = {}
49172024-09-23T23:19:49.428ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
49182024-09-23T23:19:49.431ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, lookup_type: ById(991d1ba4-4b68-4c37-85c3-fa3cf0f320b6) }, key: 09bf8117-7ca7-4472-a419-33af09f3ce6d, lookup_type: ById(09bf8117-7ca7-4472-a419-33af09f3ce6d) }, key: cb582634-f7e6-465e-a57f-e77a51bf908d, lookup_type: ById(cb582634-f7e6-465e-a57f-e77a51bf908d) } result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
49192024-09-23T23:19:49.431ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
49202024-09-23T23:19:49.431ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_node = ChainSuccessorSaga
49212024-09-23T23:19:49.439ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1333 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update
49222024-09-23T23:19:49.439ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49232024-09-23T23:19:49.439ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
49242024-09-23T23:19:49.439ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Signaled
49252024-09-23T23:19:49.439ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49262024-09-23T23:19:49.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49272024-09-23T23:19:49.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49282024-09-23T23:19:49.442ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49292024-09-23T23:19:49.442ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49302024-09-23T23:19:49.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49312024-09-23T23:19:49.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49322024-09-23T23:19:49.443ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49332024-09-23T23:19:49.443ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
49342024-09-23T23:19:49.446ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49352024-09-23T23:19:49.446ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
49362024-09-23T23:19:49.449ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49372024-09-23T23:19:49.449ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30
49382024-09-23T23:19:49.478ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49392024-09-23T23:19:49.478ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49402024-09-23T23:19:49.478ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49412024-09-23T23:19:49.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49422024-09-23T23:19:49.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49432024-09-23T23:19:49.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49442024-09-23T23:19:49.500ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49452024-09-23T23:19:49.501ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 saga_name = instance-update saga_result = SagaResult { saga_id: 7d7c6d77-9463-4273-8326-cda1543fcb30, saga_log: SagaLog { saga_id: 7d7c6d77-9463-4273-8326-cda1543fcb30, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("9b81cc52-b0a7-4bbf-8759-bcae0c243995")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("9b81cc52-b0a7-4bbf-8759-bcae0c243995")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("cb582634-f7e6-465e-a57f-e77a51bf908d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("07232b9b-c6d0-4bc1-b45b-a94bf46ac878")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("cb582634-f7e6-465e-a57f-e77a51bf908d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("07232b9b-c6d0-4bc1-b45b-a94bf46ac878")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("9b81cc52-b0a7-4bbf-8759-bcae0c243995"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("9b81cc52-b0a7-4bbf-8759-bcae0c243995")}} }) }
49462024-09-23T23:19:49.501ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 7d7c6d77-9463-4273-8326-cda1543fcb30 instance_id = cb582634-f7e6-465e-a57f-e77a51bf908d saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update
49472024-09-23T23:19:49.501ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49482024-09-23T23:19:49.501ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
49492024-09-23T23:19:49.504ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49502024-09-23T23:19:49.504ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
49512024-09-23T23:19:49.508ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49522024-09-23T23:19:49.508ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
49532024-09-23T23:19:49.511ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49542024-09-23T23:19:49.511ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b
49552024-09-23T23:19:49.516ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49562024-09-23T23:19:49.516ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49572024-09-23T23:19:49.516ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 77.21169ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49582024-09-23T23:19:49.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49592024-09-23T23:19:49.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49602024-09-23T23:19:49.523ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49612024-09-23T23:19:49.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49622024-09-23T23:19:49.525ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49632024-09-23T23:19:49.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49642024-09-23T23:19:49.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49652024-09-23T23:19:49.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49662024-09-23T23:19:49.545ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update sec_id = 212442ce-6712-4c6a-beb4-26917e04679b
49672024-09-23T23:19:49.545ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 1ed8b23e-f5c7-4c9a-89e9-42513f41005b saga_name = start-instance-update saga_result = SagaResult { saga_id: 1ed8b23e-f5c7-4c9a-89e9-42513f41005b, saga_log: SagaLog { saga_id: 1ed8b23e-f5c7-4c9a-89e9-42513f41005b, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("7877fbef-3172-4877-b5d9-63c5da16ec80")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("7877fbef-3172-4877-b5d9-63c5da16ec80")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("7877fbef-3172-4877-b5d9-63c5da16ec80"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("7877fbef-3172-4877-b5d9-63c5da16ec80")}} }) }
49682024-09-23T23:19:49.609ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49692024-09-23T23:19:49.610ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a42bc52c-05b5-4aa2-bc83-67a1fbff6104", "content-length": "691", "date": "Mon, 23 Sep 2024 23:19:49 GMT"} })
49702024-09-23T23:19:49.610ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
49712024-09-23T23:19:49.610ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
49722024-09-23T23:19:49.610ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
49732024-09-23T23:19:49.611ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 308.541136ms iteration = 16 status = {}
49742024-09-23T23:19:49.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 63b200da-5867-40dd-ba11-70805aeea9de roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49752024-09-23T23:19:49.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 63b200da-5867-40dd-ba11-70805aeea9de resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49762024-09-23T23:19:49.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = ae6c538c-ff83-4a94-a832-49c0d2367090 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
49772024-09-23T23:19:49.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = ae6c538c-ff83-4a94-a832-49c0d2367090 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
49782024-09-23T23:19:49.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 63b200da-5867-40dd-ba11-70805aeea9de response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49792024-09-23T23:19:49.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = ae6c538c-ff83-4a94-a832-49c0d2367090 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
49802024-09-23T23:19:50.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d1e885e3-1317-4c30-92dd-5b47e30db2c3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49812024-09-23T23:19:50.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d1e885e3-1317-4c30-92dd-5b47e30db2c3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49822024-09-23T23:19:50.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d1e885e3-1317-4c30-92dd-5b47e30db2c3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49832024-09-23T23:19:51.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a896895f-2589-44e4-b3b2-82d4a913cc4c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49842024-09-23T23:19:51.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a896895f-2589-44e4-b3b2-82d4a913cc4c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49852024-09-23T23:19:51.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a896895f-2589-44e4-b3b2-82d4a913cc4c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49862024-09-23T23:19:52.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 407b5e6a-9def-43a5-a201-ca93618de731 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49872024-09-23T23:19:52.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 407b5e6a-9def-43a5-a201-ca93618de731 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49882024-09-23T23:19:52.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 407b5e6a-9def-43a5-a201-ca93618de731 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49892024-09-23T23:19:53.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a7f12918-3b00-4ef5-86c8-32d6a230c32b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49902024-09-23T23:19:53.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a7f12918-3b00-4ef5-86c8-32d6a230c32b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49912024-09-23T23:19:53.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a7f12918-3b00-4ef5-86c8-32d6a230c32b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49922024-09-23T23:19:54.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e7dc1836-e1f3-41d0-a191-4c2066febe92 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49932024-09-23T23:19:54.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e7dc1836-e1f3-41d0-a191-4c2066febe92 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49942024-09-23T23:19:54.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e7dc1836-e1f3-41d0-a191-4c2066febe92 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49952024-09-23T23:19:55.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 29fac99a-6e3b-42d7-aacc-f29461fbbdee roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49962024-09-23T23:19:55.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 29fac99a-6e3b-42d7-aacc-f29461fbbdee resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49972024-09-23T23:19:55.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 29fac99a-6e3b-42d7-aacc-f29461fbbdee response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
49982024-09-23T23:19:56.179ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1418 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 1822ff88-c2d7-4d5f-bf2c-f9c652a29fdc response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
49992024-09-23T23:19:56.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7189ca61-10ab-4d13-a066-e09ddfaea0b9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50002024-09-23T23:19:56.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7189ca61-10ab-4d13-a066-e09ddfaea0b9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50012024-09-23T23:19:56.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7189ca61-10ab-4d13-a066-e09ddfaea0b9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50022024-09-23T23:19:57.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
50032024-09-23T23:19:57.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50042024-09-23T23:19:57.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50052024-09-23T23:19:57.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
50062024-09-23T23:19:57.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50072024-09-23T23:19:57.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50082024-09-23T23:19:57.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50092024-09-23T23:19:57.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50102024-09-23T23:19:57.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112024-09-23T23:19:57.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50122024-09-23T23:19:57.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50132024-09-23T23:19:57.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50142024-09-23T23:19:57.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50152024-09-23T23:19:57.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50162024-09-23T23:19:57.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50172024-09-23T23:19:57.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
50182024-09-23T23:19:57.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50192024-09-23T23:19:57.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50202024-09-23T23:19:57.849ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
50212024-09-23T23:19:57.849ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.889809ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
50222024-09-23T23:19:57.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6c76cce7-74e5-482f-88c9-e884273f6266 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50232024-09-23T23:19:57.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6c76cce7-74e5-482f-88c9-e884273f6266 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50242024-09-23T23:19:57.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6c76cce7-74e5-482f-88c9-e884273f6266 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50252024-09-23T23:19:57.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.94219ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50262024-09-23T23:19:58.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 927f1080-9905-496f-831e-1ae35984d775 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50272024-09-23T23:19:58.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 927f1080-9905-496f-831e-1ae35984d775 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50282024-09-23T23:19:58.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 927f1080-9905-496f-831e-1ae35984d775 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50292024-09-23T23:19:59.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7176c103-5302-46ae-8dc8-e9275d46fe53 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50302024-09-23T23:19:59.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7176c103-5302-46ae-8dc8-e9275d46fe53 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50312024-09-23T23:19:59.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7176c103-5302-46ae-8dc8-e9275d46fe53 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50322024-09-23T23:20:00.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 32d4c5c4-7a0c-453e-8a74-23f2427eca9e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50332024-09-23T23:20:00.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 32d4c5c4-7a0c-453e-8a74-23f2427eca9e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50342024-09-23T23:20:00.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 32d4c5c4-7a0c-453e-8a74-23f2427eca9e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50352024-09-23T23:20:01.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 967f2e02-4d66-43ce-8498-ec7cb9d5eb90 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50362024-09-23T23:20:01.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 967f2e02-4d66-43ce-8498-ec7cb9d5eb90 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50372024-09-23T23:20:01.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 967f2e02-4d66-43ce-8498-ec7cb9d5eb90 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50382024-09-23T23:20:02.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8bf69974-0319-49c1-8bd2-fd2cd4ffc8dc roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50392024-09-23T23:20:02.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8bf69974-0319-49c1-8bd2-fd2cd4ffc8dc resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50402024-09-23T23:20:02.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8bf69974-0319-49c1-8bd2-fd2cd4ffc8dc response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50412024-09-23T23:20:03.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41e7a7a4-a9ba-4312-90df-332ed54e69f7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50422024-09-23T23:20:03.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41e7a7a4-a9ba-4312-90df-332ed54e69f7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50432024-09-23T23:20:03.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41e7a7a4-a9ba-4312-90df-332ed54e69f7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50442024-09-23T23:20:05.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 624fb3bd-69bc-49e0-a42c-5793e08ae8a2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50452024-09-23T23:20:05.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 624fb3bd-69bc-49e0-a42c-5793e08ae8a2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50462024-09-23T23:20:05.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 624fb3bd-69bc-49e0-a42c-5793e08ae8a2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50472024-09-23T23:20:06.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 402d9d4e-c56e-47e6-8d25-eb88bf05180a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50482024-09-23T23:20:06.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 402d9d4e-c56e-47e6-8d25-eb88bf05180a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50492024-09-23T23:20:06.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 402d9d4e-c56e-47e6-8d25-eb88bf05180a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50502024-09-23T23:20:06.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1524 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = b3a2c1f3-ffb3-4bde-a8d9-d6243e808996 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
50512024-09-23T23:20:07.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 977f172e-3f73-43cf-8c7c-35a0421ee3df roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50522024-09-23T23:20:07.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 977f172e-3f73-43cf-8c7c-35a0421ee3df resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50532024-09-23T23:20:07.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 977f172e-3f73-43cf-8c7c-35a0421ee3df response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
50542024-09-23T23:20:07.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
50552024-09-23T23:20:07.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50562024-09-23T23:20:07.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
50572024-09-23T23:20:07.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50582024-09-23T23:20:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50592024-09-23T23:20:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50602024-09-23T23:20:07.803ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
50612024-09-23T23:20:07.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
50622024-09-23T23:20:07.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50632024-09-23T23:20:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50642024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
50652024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
50662024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50672024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50682024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
50692024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50702024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
50712024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
50722024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50732024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50742024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
50752024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50762024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
50772024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50782024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50792024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
50802024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
50812024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50822024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50832024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
50842024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50852024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
50862024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50872024-09-23T23:20:07.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 689852392 } })
50882024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50892024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50902024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50912024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50922024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50932024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50942024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50952024-09-23T23:20:07.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
50962024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50972024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50982024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50992024-09-23T23:20:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51002024-09-23T23:20:07.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51012024-09-23T23:20:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
51022024-09-23T23:20:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
51032024-09-23T23:20:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51042024-09-23T23:20:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51052024-09-23T23:20:07.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51062024-09-23T23:20:07.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51072024-09-23T23:20:07.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 691747214 } })
51082024-09-23T23:20:07.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51092024-09-23T23:20:07.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
51102024-09-23T23:20:07.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51112024-09-23T23:20:07.808ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.766684ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51122024-09-23T23:20:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51132024-09-23T23:20:07.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51142024-09-23T23:20:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51152024-09-23T23:20:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51162024-09-23T23:20:07.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51172024-09-23T23:20:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51182024-09-23T23:20:07.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51192024-09-23T23:20:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51202024-09-23T23:20:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51212024-09-23T23:20:07.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51222024-09-23T23:20:07.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51232024-09-23T23:20:07.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51242024-09-23T23:20:07.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51252024-09-23T23:20:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51262024-09-23T23:20:07.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51272024-09-23T23:20:07.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51282024-09-23T23:20:07.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51292024-09-23T23:20:07.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51302024-09-23T23:20:07.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51312024-09-23T23:20:07.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51322024-09-23T23:20:07.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51332024-09-23T23:20:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51342024-09-23T23:20:07.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51352024-09-23T23:20:07.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51362024-09-23T23:20:07.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51372024-09-23T23:20:07.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51382024-09-23T23:20:07.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51392024-09-23T23:20:07.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51402024-09-23T23:20:07.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51412024-09-23T23:20:07.849ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51422024-09-23T23:20:07.849ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51432024-09-23T23:20:07.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51442024-09-23T23:20:07.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51452024-09-23T23:20:07.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51462024-09-23T23:20:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51472024-09-23T23:20:07.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51482024-09-23T23:20:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51492024-09-23T23:20:07.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 742321866 } })
51502024-09-23T23:20:07.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.253023ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
51512024-09-23T23:20:07.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51522024-09-23T23:20:07.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.10563ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
51532024-09-23T23:20:07.859ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
51542024-09-23T23:20:07.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51552024-09-23T23:20:07.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51562024-09-23T23:20:07.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51572024-09-23T23:20:07.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51582024-09-23T23:20:07.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51592024-09-23T23:20:07.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51602024-09-23T23:20:07.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51612024-09-23T23:20:07.864ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51622024-09-23T23:20:07.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.453065ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
51632024-09-23T23:20:07.864ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51642024-09-23T23:20:07.865ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51652024-09-23T23:20:07.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51662024-09-23T23:20:07.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51672024-09-23T23:20:07.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51682024-09-23T23:20:07.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51692024-09-23T23:20:07.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.63272ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51702024-09-23T23:20:07.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51712024-09-23T23:20:07.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51722024-09-23T23:20:07.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51732024-09-23T23:20:07.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51742024-09-23T23:20:07.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51752024-09-23T23:20:07.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
51762024-09-23T23:20:07.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51772024-09-23T23:20:07.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51782024-09-23T23:20:07.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51792024-09-23T23:20:07.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51802024-09-23T23:20:07.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
51812024-09-23T23:20:07.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.609706ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
51822024-09-23T23:20:07.882ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
51832024-09-23T23:20:07.882ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51842024-09-23T23:20:07.882ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b3da9497-3899-471f-8181-d3fc73ebc21a", "content-length": "26", "date": "Mon, 23 Sep 2024 23:20:07 GMT"} })
51852024-09-23T23:20:07.882ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51862024-09-23T23:20:07.885ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51872024-09-23T23:20:07.886ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
51882024-09-23T23:20:07.886ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51892024-09-23T23:20:07.886ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b5905425-29c5-47f5-89fe-c59c312309fc", "content-length": "26", "date": "Mon, 23 Sep 2024 23:20:07 GMT"} })
51902024-09-23T23:20:07.886ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51912024-09-23T23:20:07.888ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51922024-09-23T23:20:07.891ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51932024-09-23T23:20:07.891ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51942024-09-23T23:20:07.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51952024-09-23T23:20:07.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51962024-09-23T23:20:07.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.567506ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51972024-09-23T23:20:07.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.249208ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51982024-09-23T23:20:07.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51992024-09-23T23:20:07.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.920581ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52002024-09-23T23:20:07.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
52012024-09-23T23:20:07.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52022024-09-23T23:20:07.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52032024-09-23T23:20:07.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52042024-09-23T23:20:07.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52052024-09-23T23:20:07.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52062024-09-23T23:20:07.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52072024-09-23T23:20:07.922ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 117.441774ms iteration = 19 status = {"physical_disks_added":0}
52082024-09-23T23:20:07.926ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52092024-09-23T23:20:07.926ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52102024-09-23T23:20:07.926ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.968704ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52112024-09-23T23:20:07.952ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
52122024-09-23T23:20:07.952ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52132024-09-23T23:20:07.952ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9f94eec4-cc6e-4ce9-884b-e80c6306a462", "content-length": "26", "date": "Mon, 23 Sep 2024 23:20:07 GMT"} })
52142024-09-23T23:20:07.952ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52152024-09-23T23:20:07.954ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
52162024-09-23T23:20:07.996ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.205809ms iteration = 16 status = {}
52172024-09-23T23:20:07.998ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52182024-09-23T23:20:07.998ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e0cf6d1a-f6f3-42eb-bcbd-d93ab0bfc547", "content-length": "2", "date": "Mon, 23 Sep 2024 23:20:07 GMT"} })
52192024-09-23T23:20:08.000ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52202024-09-23T23:20:08.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52212024-09-23T23:20:08.016ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52222024-09-23T23:20:08.016ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e39d7d16-73b9-4c90-a598-4250c927cffd", "content-length": "372", "date": "Mon, 23 Sep 2024 23:20:07 GMT"} })
52232024-09-23T23:20:08.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52242024-09-23T23:20:08.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52252024-09-23T23:20:08.018ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 213.065316ms iteration = 16 status = 0
52262024-09-23T23:20:08.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52272024-09-23T23:20:08.018ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 216.01888ms iteration = 16 status = null
52282024-09-23T23:20:08.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52292024-09-23T23:20:08.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52302024-09-23T23:20:08.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52312024-09-23T23:20:08.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52322024-09-23T23:20:08.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52332024-09-23T23:20:08.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52342024-09-23T23:20:08.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52352024-09-23T23:20:08.026ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52362024-09-23T23:20:08.026ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "258f8fad-c424-4d94-9753-230d9c2d5ce2", "date": "Mon, 23 Sep 2024 23:20:07 GMT"} })
52372024-09-23T23:20:08.028ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 222.707447ms iteration = 18 status = {}
52382024-09-23T23:20:08.081ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52392024-09-23T23:20:08.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52402024-09-23T23:20:08.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52412024-09-23T23:20:08.117ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
52422024-09-23T23:20:08.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52432024-09-23T23:20:08.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52442024-09-23T23:20:08.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52452024-09-23T23:20:08.128ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6481b221-be24-4877-a13a-89900f960865", "content-length": "121", "date": "Mon, 23 Sep 2024 23:20:07 GMT"} })
52462024-09-23T23:20:08.128ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
52472024-09-23T23:20:08.128ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
52482024-09-23T23:20:08.129ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52492024-09-23T23:20:08.129ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52502024-09-23T23:20:08.129ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
52512024-09-23T23:20:08.129ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
52522024-09-23T23:20:08.129ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
52532024-09-23T23:20:08.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52542024-09-23T23:20:08.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52552024-09-23T23:20:08.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52562024-09-23T23:20:08.131ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f663795-f833-4219-8864-b0f09ba18ba6", "content-length": "2", "date": "Mon, 23 Sep 2024 23:20:07 GMT"} })
52572024-09-23T23:20:08.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52582024-09-23T23:20:08.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7e6e8e1c-584b-4cbe-9f62-32482eed95f6", "content-length": "52", "date": "Mon, 23 Sep 2024 23:20:07 GMT"} })
52592024-09-23T23:20:08.132ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
52602024-09-23T23:20:08.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52612024-09-23T23:20:08.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d628954a-920a-496d-a8b4-0e6784c6800e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52622024-09-23T23:20:08.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d628954a-920a-496d-a8b4-0e6784c6800e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52632024-09-23T23:20:08.188ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "983f791f-69ac-4b9f-befc-001f97d639e0", "content-length": "691", "date": "Mon, 23 Sep 2024 23:20:08 GMT"} })
52642024-09-23T23:20:08.188ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
52652024-09-23T23:20:08.188ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
52662024-09-23T23:20:08.188ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
52672024-09-23T23:20:08.190ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 384.917436ms iteration = 17 status = {}
52682024-09-23T23:20:08.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d628954a-920a-496d-a8b4-0e6784c6800e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52692024-09-23T23:20:08.292ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e1e00fa0-2f26-4291-a117-1b1479ae3edc", "date": "Mon, 23 Sep 2024 23:20:08 GMT"} })
52702024-09-23T23:20:08.292ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
52712024-09-23T23:20:08.292ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52722024-09-23T23:20:08.296ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9c9cbd0-4931-42f2-863b-50c5299fd612", "content-length": "667", "date": "Mon, 23 Sep 2024 23:20:08 GMT"} })
52732024-09-23T23:20:08.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52742024-09-23T23:20:08.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52752024-09-23T23:20:08.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52762024-09-23T23:20:08.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52772024-09-23T23:20:08.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52782024-09-23T23:20:08.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52792024-09-23T23:20:08.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52802024-09-23T23:20:08.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52812024-09-23T23:20:08.314ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 508.925065ms iteration = 16 status = {}
52822024-09-23T23:20:09.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b3cd8a24-beda-429c-85ff-434ba6726529 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52832024-09-23T23:20:09.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b3cd8a24-beda-429c-85ff-434ba6726529 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52842024-09-23T23:20:09.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b3cd8a24-beda-429c-85ff-434ba6726529 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52852024-09-23T23:20:10.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8488802c-3bc4-4d44-b633-0be84b7a0caa roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52862024-09-23T23:20:10.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8488802c-3bc4-4d44-b633-0be84b7a0caa resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52872024-09-23T23:20:10.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8488802c-3bc4-4d44-b633-0be84b7a0caa response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52882024-09-23T23:20:11.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 32409bc2-4161-4c9e-a19b-e24d66ca2775 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52892024-09-23T23:20:11.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 32409bc2-4161-4c9e-a19b-e24d66ca2775 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52902024-09-23T23:20:11.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 32409bc2-4161-4c9e-a19b-e24d66ca2775 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52912024-09-23T23:20:12.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7539724b-5580-4caf-a9e8-50543d4ba7e1 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52922024-09-23T23:20:12.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7539724b-5580-4caf-a9e8-50543d4ba7e1 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52932024-09-23T23:20:12.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7539724b-5580-4caf-a9e8-50543d4ba7e1 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52942024-09-23T23:20:13.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4038928b-8e63-46d3-bdd2-87eeb5112053 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52952024-09-23T23:20:13.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4038928b-8e63-46d3-bdd2-87eeb5112053 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52962024-09-23T23:20:13.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4038928b-8e63-46d3-bdd2-87eeb5112053 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52972024-09-23T23:20:14.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2a5c3c65-4a41-42d6-96f7-dc4d9b96861d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52982024-09-23T23:20:14.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2a5c3c65-4a41-42d6-96f7-dc4d9b96861d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
52992024-09-23T23:20:14.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2a5c3c65-4a41-42d6-96f7-dc4d9b96861d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53002024-09-23T23:20:15.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e303c32d-d2e0-4640-b8c0-6866500806b9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53012024-09-23T23:20:15.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e303c32d-d2e0-4640-b8c0-6866500806b9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53022024-09-23T23:20:15.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e303c32d-d2e0-4640-b8c0-6866500806b9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53032024-09-23T23:20:16.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1433 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 256e1210-257b-422d-bccb-ab9dbae0f52b response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
53042024-09-23T23:20:16.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 531c401e-0f74-4e76-a3ae-0fbf6b2f1afc roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53052024-09-23T23:20:16.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 531c401e-0f74-4e76-a3ae-0fbf6b2f1afc resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53062024-09-23T23:20:16.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 531c401e-0f74-4e76-a3ae-0fbf6b2f1afc response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53072024-09-23T23:20:17.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9e49a96a-8fdd-47da-9d7d-dd43b5af3ba4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53082024-09-23T23:20:17.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9e49a96a-8fdd-47da-9d7d-dd43b5af3ba4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53092024-09-23T23:20:17.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9e49a96a-8fdd-47da-9d7d-dd43b5af3ba4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53102024-09-23T23:20:17.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
53112024-09-23T23:20:17.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53122024-09-23T23:20:17.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53132024-09-23T23:20:17.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53142024-09-23T23:20:17.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
53152024-09-23T23:20:17.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53162024-09-23T23:20:17.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53172024-09-23T23:20:17.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53182024-09-23T23:20:17.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53192024-09-23T23:20:17.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53202024-09-23T23:20:17.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53212024-09-23T23:20:17.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53222024-09-23T23:20:17.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53232024-09-23T23:20:17.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
53242024-09-23T23:20:17.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53252024-09-23T23:20:17.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53262024-09-23T23:20:17.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
53272024-09-23T23:20:17.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.219192ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
53282024-09-23T23:20:17.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53292024-09-23T23:20:17.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53302024-09-23T23:20:17.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.303038ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53312024-09-23T23:20:18.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 967384bf-5668-41e4-8b61-45ccd550ed6e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53322024-09-23T23:20:18.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 967384bf-5668-41e4-8b61-45ccd550ed6e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53332024-09-23T23:20:18.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 967384bf-5668-41e4-8b61-45ccd550ed6e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53342024-09-23T23:20:19.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3b545231-3fdc-45bc-96c9-a34ecf38aac0 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53352024-09-23T23:20:19.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3b545231-3fdc-45bc-96c9-a34ecf38aac0 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53362024-09-23T23:20:19.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3b545231-3fdc-45bc-96c9-a34ecf38aac0 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53372024-09-23T23:20:19.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = ca93b20a-3579-45c0-bbed-57575a587755 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
53382024-09-23T23:20:19.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = ca93b20a-3579-45c0-bbed-57575a587755 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
53392024-09-23T23:20:19.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = ca93b20a-3579-45c0-bbed-57575a587755 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
53402024-09-23T23:20:20.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9423ad08-3c38-4ab1-be33-9acdaa6c189c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53412024-09-23T23:20:20.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9423ad08-3c38-4ab1-be33-9acdaa6c189c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53422024-09-23T23:20:20.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9423ad08-3c38-4ab1-be33-9acdaa6c189c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53432024-09-23T23:20:21.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c44ad299-085a-4a11-8abb-ac3e23e40cc3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53442024-09-23T23:20:21.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c44ad299-085a-4a11-8abb-ac3e23e40cc3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53452024-09-23T23:20:21.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2629 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c44ad299-085a-4a11-8abb-ac3e23e40cc3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53462024-09-23T23:20:22.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9c8ead0d-79b4-4d9a-88d3-942996077a07 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53472024-09-23T23:20:22.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9c8ead0d-79b4-4d9a-88d3-942996077a07 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53482024-09-23T23:20:22.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9c8ead0d-79b4-4d9a-88d3-942996077a07 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53492024-09-23T23:20:23.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a495f273-b29a-4119-8058-2409586c47e7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53502024-09-23T23:20:23.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a495f273-b29a-4119-8058-2409586c47e7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53512024-09-23T23:20:23.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a495f273-b29a-4119-8058-2409586c47e7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53522024-09-23T23:20:24.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8b016d27-b17a-441a-b920-84900902fea4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53532024-09-23T23:20:24.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8b016d27-b17a-441a-b920-84900902fea4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53542024-09-23T23:20:24.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8b016d27-b17a-441a-b920-84900902fea4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53552024-09-23T23:20:25.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a8266531-00d3-47eb-9475-67cedb1feb98 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53562024-09-23T23:20:25.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a8266531-00d3-47eb-9475-67cedb1feb98 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53572024-09-23T23:20:25.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a8266531-00d3-47eb-9475-67cedb1feb98 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53582024-09-23T23:20:26.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 6f834f6e-557a-44af-9176-ec46bcc6eda3 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
53592024-09-23T23:20:26.181ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
53602024-09-23T23:20:26.181ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
53612024-09-23T23:20:26.211ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
53622024-09-23T23:20:26.211ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:62773
53632024-09-23T23:20:26.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62773 req_id = 393bcffa-b993-4402-8adb-a0e5a3ac589c roles = RoleSet { roles: {} } uri = /metrics/producers
53642024-09-23T23:20:26.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62773 req_id = 393bcffa-b993-4402-8adb-a0e5a3ac589c resource = Database result = Ok(()) uri = /metrics/producers
53652024-09-23T23:20:26.244ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
53662024-09-23T23:20:26.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62773 req_id = 393bcffa-b993-4402-8adb-a0e5a3ac589c roles = RoleSet { roles: {} } uri = /metrics/producers
53672024-09-23T23:20:26.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62773 req_id = 393bcffa-b993-4402-8adb-a0e5a3ac589c resource = Database result = Ok(()) uri = /metrics/producers
53682024-09-23T23:20:26.279ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
53692024-09-23T23:20:26.280ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f137feb0-c2d8-4923-a4d1-47e503353ee2", "date": "Mon, 23 Sep 2024 23:20:26 GMT"} })
53702024-09-23T23:20:26.280ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = 212442ce-6712-4c6a-beb4-26917e04679b
53712024-09-23T23:20:26.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69359 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62773 req_id = 393bcffa-b993-4402-8adb-a0e5a3ac589c response_code = 201 uri = /metrics/producers
53722024-09-23T23:20:26.281ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "393bcffa-b993-4402-8adb-a0e5a3ac589c", "content-length": "41", "date": "Mon, 23 Sep 2024 23:20:25 GMT"} })
53732024-09-23T23:20:26.282ZDEBGnexus (producer-registration-task): registered with nexus successfully
53742024-09-23T23:20:26.282ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
53752024-09-23T23:20:26.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d7c8d97a-a6ca-4712-a7cc-c2ce18fd49b4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53762024-09-23T23:20:26.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d7c8d97a-a6ca-4712-a7cc-c2ce18fd49b4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53772024-09-23T23:20:26.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d7c8d97a-a6ca-4712-a7cc-c2ce18fd49b4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53782024-09-23T23:20:27.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68aab847-dcda-45c0-9ff3-cdf8b7b23f3c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53792024-09-23T23:20:27.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68aab847-dcda-45c0-9ff3-cdf8b7b23f3c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53802024-09-23T23:20:27.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68aab847-dcda-45c0-9ff3-cdf8b7b23f3c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
53812024-09-23T23:20:27.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
53822024-09-23T23:20:27.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53832024-09-23T23:20:27.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53842024-09-23T23:20:27.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
53852024-09-23T23:20:27.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53862024-09-23T23:20:27.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53872024-09-23T23:20:27.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53882024-09-23T23:20:27.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53892024-09-23T23:20:27.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53902024-09-23T23:20:27.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53912024-09-23T23:20:27.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53922024-09-23T23:20:27.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53932024-09-23T23:20:27.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.381939ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53942024-09-23T23:20:27.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53952024-09-23T23:20:27.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53962024-09-23T23:20:27.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972024-09-23T23:20:27.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
53982024-09-23T23:20:27.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53992024-09-23T23:20:27.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54002024-09-23T23:20:27.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
54012024-09-23T23:20:27.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.861693ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
54022024-09-23T23:20:28.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dfee7c65-441b-44f7-9480-fa277bba74ea roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54032024-09-23T23:20:28.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dfee7c65-441b-44f7-9480-fa277bba74ea resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54042024-09-23T23:20:28.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dfee7c65-441b-44f7-9480-fa277bba74ea response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54052024-09-23T23:20:29.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9652fcbd-cb2d-4db1-8b73-377c5c730878 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54062024-09-23T23:20:29.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9652fcbd-cb2d-4db1-8b73-377c5c730878 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54072024-09-23T23:20:29.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9652fcbd-cb2d-4db1-8b73-377c5c730878 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54082024-09-23T23:20:30.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4100a158-aa7e-4843-888c-2a6fc398145d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54092024-09-23T23:20:30.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4100a158-aa7e-4843-888c-2a6fc398145d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54102024-09-23T23:20:30.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4100a158-aa7e-4843-888c-2a6fc398145d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54112024-09-23T23:20:31.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8234d1ed-5271-4654-b46e-515fc8d94253 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54122024-09-23T23:20:31.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8234d1ed-5271-4654-b46e-515fc8d94253 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54132024-09-23T23:20:31.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8234d1ed-5271-4654-b46e-515fc8d94253 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54142024-09-23T23:20:32.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d613cb0d-454f-4b53-8afb-c8fa00237a70 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54152024-09-23T23:20:32.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d613cb0d-454f-4b53-8afb-c8fa00237a70 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54162024-09-23T23:20:32.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d613cb0d-454f-4b53-8afb-c8fa00237a70 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54172024-09-23T23:20:33.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 547e9ff6-0c04-4b0e-9c31-86c16fdb791b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54182024-09-23T23:20:33.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 547e9ff6-0c04-4b0e-9c31-86c16fdb791b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54192024-09-23T23:20:33.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 547e9ff6-0c04-4b0e-9c31-86c16fdb791b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54202024-09-23T23:20:34.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e938661f-14c5-4840-88cf-b11732d0048c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54212024-09-23T23:20:34.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e938661f-14c5-4840-88cf-b11732d0048c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54222024-09-23T23:20:34.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e938661f-14c5-4840-88cf-b11732d0048c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54232024-09-23T23:20:35.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dc52334b-d56b-486e-afab-3ae6d82efe27 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54242024-09-23T23:20:35.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dc52334b-d56b-486e-afab-3ae6d82efe27 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54252024-09-23T23:20:35.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dc52334b-d56b-486e-afab-3ae6d82efe27 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54262024-09-23T23:20:36.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1630 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 10e2f46f-d086-4ef9-b80d-a4ada7a59bd9 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
54272024-09-23T23:20:36.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c169fce1-1deb-43fc-bf3d-1b7ad1fca0a4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54282024-09-23T23:20:36.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c169fce1-1deb-43fc-bf3d-1b7ad1fca0a4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54292024-09-23T23:20:36.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c169fce1-1deb-43fc-bf3d-1b7ad1fca0a4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
54302024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
54312024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54322024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
54332024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
54342024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
54352024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
54362024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54372024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54382024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
54392024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
54402024-09-23T23:20:37.802ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-23 23:10:37.802551875 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
54412024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
54422024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54432024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
54442024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
54452024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
54462024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54472024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
54482024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
54492024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54502024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54512024-09-23T23:20:37.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54522024-09-23T23:20:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54532024-09-23T23:20:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54542024-09-23T23:20:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
54552024-09-23T23:20:37.803ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65799211-2178-4ef6-a14b-629ea048347e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2729181-3180-4ecf-bd42-a48f1144b71d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 687621776 } })
54562024-09-23T23:20:37.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
54572024-09-23T23:20:37.803ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82
54582024-09-23T23:20:37.803ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
54592024-09-23T23:20:37.803ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.701\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82"}
54602024-09-23T23:20:37.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
54612024-09-23T23:20:37.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54622024-09-23T23:20:37.803ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("954a3d10-a2dd-433b-9252-ede695863bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 687871509 } })
54632024-09-23T23:20:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54642024-09-23T23:20:37.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54652024-09-23T23:20:37.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54662024-09-23T23:20:37.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54672024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54682024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
54692024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
54702024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
54712024-09-23T23:20:37.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
54722024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
54732024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54742024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54752024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
54762024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54772024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
54782024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
54792024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54802024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54812024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54822024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
54832024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54842024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
54852024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
54862024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
54872024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.988235ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
54882024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54892024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
54902024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54912024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
54922024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54932024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54942024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
54952024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
54962024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54972024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54982024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
54992024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55002024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
55012024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55022024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
55032024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
55042024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.234097ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
55052024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
55062024-09-23T23:20:37.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 690167065 } })
55072024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
55082024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55092024-09-23T23:20:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55102024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55112024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55122024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55132024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55142024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55152024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55162024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55172024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55182024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55192024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55202024-09-23T23:20:37.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55212024-09-23T23:20:37.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
55222024-09-23T23:20:37.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55232024-09-23T23:20:37.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
55242024-09-23T23:20:37.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55252024-09-23T23:20:37.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
55262024-09-23T23:20:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55272024-09-23T23:20:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
55282024-09-23T23:20:37.808ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-23 23:10:37.802551875 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
55292024-09-23T23:20:37.808ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.954278ms iteration = 9 status = {"expiration":"2024-09-23T23:10:37.802551875Z","pruned":[]}
55302024-09-23T23:20:37.808ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 692949517 } })
55312024-09-23T23:20:37.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
55322024-09-23T23:20:37.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55332024-09-23T23:20:37.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55342024-09-23T23:20:37.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55352024-09-23T23:20:37.810ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.308555ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
55362024-09-23T23:20:37.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372024-09-23T23:20:37.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55382024-09-23T23:20:37.812ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55392024-09-23T23:20:37.813ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.026923ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
55402024-09-23T23:20:37.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55412024-09-23T23:20:37.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
55422024-09-23T23:20:37.815ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55432024-09-23T23:20:37.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55442024-09-23T23:20:37.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
55452024-09-23T23:20:37.816ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55462024-09-23T23:20:37.816ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55472024-09-23T23:20:37.816ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55482024-09-23T23:20:37.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55492024-09-23T23:20:37.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55502024-09-23T23:20:37.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55512024-09-23T23:20:37.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55522024-09-23T23:20:37.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
55532024-09-23T23:20:37.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55542024-09-23T23:20:37.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55552024-09-23T23:20:37.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55562024-09-23T23:20:37.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55572024-09-23T23:20:37.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55582024-09-23T23:20:37.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55592024-09-23T23:20:37.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55602024-09-23T23:20:37.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55612024-09-23T23:20:37.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55622024-09-23T23:20:37.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55632024-09-23T23:20:37.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55642024-09-23T23:20:37.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55652024-09-23T23:20:37.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55662024-09-23T23:20:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55672024-09-23T23:20:37.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55682024-09-23T23:20:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55692024-09-23T23:20:37.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55702024-09-23T23:20:37.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55712024-09-23T23:20:37.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55722024-09-23T23:20:37.836ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55732024-09-23T23:20:37.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55742024-09-23T23:20:37.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 31.322701ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55752024-09-23T23:20:37.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.427002ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55762024-09-23T23:20:37.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55772024-09-23T23:20:37.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
55782024-09-23T23:20:37.840ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55792024-09-23T23:20:37.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55802024-09-23T23:20:37.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5f696ab8-5d79-402f-8ef2-87d9f0b47bf7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
55812024-09-23T23:20:37.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55822024-09-23T23:20:37.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5f696ab8-5d79-402f-8ef2-87d9f0b47bf7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
55832024-09-23T23:20:37.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55842024-09-23T23:20:37.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 731929446 } })
55852024-09-23T23:20:37.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55862024-09-23T23:20:37.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55872024-09-23T23:20:37.849ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
55882024-09-23T23:20:37.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55892024-09-23T23:20:37.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5f696ab8-5d79-402f-8ef2-87d9f0b47bf7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
55902024-09-23T23:20:37.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55912024-09-23T23:20:37.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55922024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55932024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55942024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55952024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55962024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55972024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55982024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55992024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56002024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56012024-09-23T23:20:37.853ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56022024-09-23T23:20:37.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56032024-09-23T23:20:37.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56042024-09-23T23:20:37.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56052024-09-23T23:20:37.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56062024-09-23T23:20:37.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56072024-09-23T23:20:37.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56082024-09-23T23:20:37.857ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56092024-09-23T23:20:37.857ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56102024-09-23T23:20:37.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56112024-09-23T23:20:37.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56122024-09-23T23:20:37.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56132024-09-23T23:20:37.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56142024-09-23T23:20:37.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56152024-09-23T23:20:37.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56162024-09-23T23:20:37.860ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56172024-09-23T23:20:37.860ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56182024-09-23T23:20:37.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56192024-09-23T23:20:37.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56202024-09-23T23:20:37.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56212024-09-23T23:20:37.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56222024-09-23T23:20:37.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56232024-09-23T23:20:37.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56242024-09-23T23:20:37.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56252024-09-23T23:20:37.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56262024-09-23T23:20:37.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56272024-09-23T23:20:37.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
56282024-09-23T23:20:37.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56292024-09-23T23:20:37.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56302024-09-23T23:20:37.869ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56312024-09-23T23:20:37.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56322024-09-23T23:20:37.869ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
56332024-09-23T23:20:37.870ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
56342024-09-23T23:20:37.870ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.481113ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
56352024-09-23T23:20:37.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.387682ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
56362024-09-23T23:20:37.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56372024-09-23T23:20:37.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56382024-09-23T23:20:37.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56392024-09-23T23:20:37.873ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56402024-09-23T23:20:37.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56412024-09-23T23:20:37.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56422024-09-23T23:20:37.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56432024-09-23T23:20:37.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.994696ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
56442024-09-23T23:20:37.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
56452024-09-23T23:20:37.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.944552ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
56462024-09-23T23:20:37.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56472024-09-23T23:20:37.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56482024-09-23T23:20:37.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56492024-09-23T23:20:37.878ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56502024-09-23T23:20:37.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56512024-09-23T23:20:37.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56522024-09-23T23:20:37.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56532024-09-23T23:20:37.881ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
56542024-09-23T23:20:37.881ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
56552024-09-23T23:20:37.881ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.783403ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
56562024-09-23T23:20:37.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56572024-09-23T23:20:37.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
56582024-09-23T23:20:37.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56592024-09-23T23:20:37.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56602024-09-23T23:20:37.884ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
56612024-09-23T23:20:37.884ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
56622024-09-23T23:20:37.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56632024-09-23T23:20:37.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56642024-09-23T23:20:37.885ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.370737ms iteration = 17 status = 0
56652024-09-23T23:20:37.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56662024-09-23T23:20:37.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56672024-09-23T23:20:37.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56682024-09-23T23:20:37.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56692024-09-23T23:20:37.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.814957ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
56702024-09-23T23:20:37.891ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
56712024-09-23T23:20:37.891ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56722024-09-23T23:20:37.891ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-23 23:12:39.428682 UTC dns_group = internal generation = 1
56732024-09-23T23:20:37.891ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 89.427991ms iteration = 10 status = {"generation":1}
56742024-09-23T23:20:37.895ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 90.406162ms iteration = 20 status = {"physical_disks_added":0}
56752024-09-23T23:20:37.901ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
56762024-09-23T23:20:37.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 95.596362ms iteration = 9 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
56772024-09-23T23:20:37.902ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
56782024-09-23T23:20:37.902ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 0 version = 2
56792024-09-23T23:20:37.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56802024-09-23T23:20:37.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56812024-09-23T23:20:37.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56822024-09-23T23:20:37.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56832024-09-23T23:20:37.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56842024-09-23T23:20:37.909ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-23T23:12:36.221760Z, time_modified: 2024-09-23T23:12:36.221760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }) }
56852024-09-23T23:20:37.909ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 106.476637ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]}},"default_endpoint":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56862024-09-23T23:20:37.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56872024-09-23T23:20:37.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56882024-09-23T23:20:37.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56892024-09-23T23:20:37.909ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56902024-09-23T23:20:37.909ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56912024-09-23T23:20:37.909ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.184441ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56922024-09-23T23:20:37.911ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 1 version = 2
56932024-09-23T23:20:37.911ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56942024-09-23T23:20:37.911ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-23 23:12:40.294485 UTC dns_group = external generation = 2
56952024-09-23T23:20:37.911ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 109.233359ms iteration = 10 status = {"generation":2}
56962024-09-23T23:20:37.920ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56972024-09-23T23:20:37.920ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.51919ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56982024-09-23T23:20:37.944ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.896688ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
56992024-09-23T23:20:37.989ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
57002024-09-23T23:20:37.989ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57012024-09-23T23:20:37.990ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "13e1478e-9f1e-4aa0-87f2-0ac5f8efa000", "content-length": "26", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} })
57022024-09-23T23:20:37.990ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57032024-09-23T23:20:37.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57042024-09-23T23:20:37.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57052024-09-23T23:20:37.995ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57062024-09-23T23:20:37.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57072024-09-23T23:20:37.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57082024-09-23T23:20:37.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57092024-09-23T23:20:37.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57102024-09-23T23:20:38.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57112024-09-23T23:20:38.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57122024-09-23T23:20:38.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57132024-09-23T23:20:38.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57142024-09-23T23:20:38.033ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
57152024-09-23T23:20:38.185ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
57162024-09-23T23:20:38.212ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 409.377368ms iteration = 17 status = {}
57172024-09-23T23:20:38.217ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57182024-09-23T23:20:38.217ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2b60664c-08cb-4ecd-8693-5836043c3f28", "content-length": "691", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} })
57192024-09-23T23:20:38.217ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
57202024-09-23T23:20:38.217ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
57212024-09-23T23:20:38.217ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
57222024-09-23T23:20:38.219ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 414.108562ms iteration = 18 status = {}
57232024-09-23T23:20:38.224ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57242024-09-23T23:20:38.224ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f6c24860-2af2-4455-9960-b3f103d0a746", "content-length": "372", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} })
57252024-09-23T23:20:38.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57262024-09-23T23:20:38.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57272024-09-23T23:20:38.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57282024-09-23T23:20:38.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57292024-09-23T23:20:38.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57302024-09-23T23:20:38.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57312024-09-23T23:20:38.234ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57322024-09-23T23:20:38.234ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "56dd11a0-b614-4cf6-801f-78a2c944fee4", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} })
57332024-09-23T23:20:38.236ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 431.24267ms iteration = 19 status = {}
57342024-09-23T23:20:38.264ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
57352024-09-23T23:20:38.264ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57362024-09-23T23:20:38.265ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a84d1c9a-0272-4d1d-a918-de77b0ee5793", "content-length": "26", "date": "Mon, 23 Sep 2024 23:20:38 GMT"} })
57372024-09-23T23:20:38.265ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57382024-09-23T23:20:38.267ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57392024-09-23T23:20:38.277ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
57402024-09-23T23:20:38.278ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "80e5b364-6f9c-4b0f-8128-54d10598733c", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57412024-09-23T23:20:38.278ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57422024-09-23T23:20:38.278ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
57432024-09-23T23:20:38.278ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57442024-09-23T23:20:38.279ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2405e19a-dfbb-472a-8085-e8f170667e79", "content-length": "26", "date": "Mon, 23 Sep 2024 23:20:38 GMT"} })
57452024-09-23T23:20:38.279ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57462024-09-23T23:20:38.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "82442723-99b0-48af-add4-5736a2884ece", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57472024-09-23T23:20:38.280ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57482024-09-23T23:20:38.281ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
57492024-09-23T23:20:38.283ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57502024-09-23T23:20:38.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 480.836941ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
57512024-09-23T23:20:38.352ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57522024-09-23T23:20:38.352ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "989ca00c-f481-4d28-8ff3-4db642ee3190", "content-length": "2", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} })
57532024-09-23T23:20:38.355ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57542024-09-23T23:20:38.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57552024-09-23T23:20:38.356ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 554.44534ms iteration = 17 status = null
57562024-09-23T23:20:38.404ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57572024-09-23T23:20:38.531ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
57582024-09-23T23:20:38.532ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "82125889-ca54-41d3-a791-963a31d10c5c", "date": "Mon, 23 Sep 2024 23:20:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57592024-09-23T23:20:38.532ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57602024-09-23T23:20:38.534ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bd841a43-23b0-4137-8577-4786822ecc47", "date": "Mon, 23 Sep 2024 23:20:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57612024-09-23T23:20:38.534ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57622024-09-23T23:20:38.536ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a0c74195-aa9a-4298-b71c-3d25c9fb8af3", "date": "Mon, 23 Sep 2024 23:20:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57632024-09-23T23:20:38.536ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57642024-09-23T23:20:38.537ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57652024-09-23T23:20:38.538ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 735.408016ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
57662024-09-23T23:20:38.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57672024-09-23T23:20:38.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57682024-09-23T23:20:38.571ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
57692024-09-23T23:20:38.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57702024-09-23T23:20:38.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57712024-09-23T23:20:38.580ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57722024-09-23T23:20:38.580ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d6c9b67b-2b41-450e-945d-002c9b67fee7", "content-length": "121", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} })
57732024-09-23T23:20:38.580ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
57742024-09-23T23:20:38.580ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
57752024-09-23T23:20:38.581ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57762024-09-23T23:20:38.581ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57772024-09-23T23:20:38.581ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
57782024-09-23T23:20:38.581ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
57792024-09-23T23:20:38.581ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
57802024-09-23T23:20:38.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57812024-09-23T23:20:38.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57822024-09-23T23:20:38.583ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57832024-09-23T23:20:38.583ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3bb0e7ea-ec24-4630-83b0-4bdb13acb431", "content-length": "2", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} })
57842024-09-23T23:20:38.583ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57852024-09-23T23:20:38.583ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87a6ef2b-387a-48f4-b887-897273ea89ea", "content-length": "52", "date": "Mon, 23 Sep 2024 23:20:37 GMT"} })
57862024-09-23T23:20:38.583ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
57872024-09-23T23:20:38.583ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57882024-09-23T23:20:38.669ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7334d8fa-3a8f-4ee3-adb6-7104327c4b71", "date": "Mon, 23 Sep 2024 23:20:38 GMT"} })
57892024-09-23T23:20:38.669ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
57902024-09-23T23:20:38.669ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57912024-09-23T23:20:38.669ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "41826136-9335-45e1-b6a0-a24be1cbd114", "content-length": "667", "date": "Mon, 23 Sep 2024 23:20:38 GMT"} })
57922024-09-23T23:20:38.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57932024-09-23T23:20:38.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57942024-09-23T23:20:38.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57952024-09-23T23:20:38.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57962024-09-23T23:20:38.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57972024-09-23T23:20:38.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57982024-09-23T23:20:38.678ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57992024-09-23T23:20:38.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58002024-09-23T23:20:38.685ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 879.81339ms iteration = 17 status = {}
58012024-09-23T23:20:38.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2947634a-d6bc-4f9a-8682-379f4aff9715 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58022024-09-23T23:20:38.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2947634a-d6bc-4f9a-8682-379f4aff9715 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58032024-09-23T23:20:38.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2947634a-d6bc-4f9a-8682-379f4aff9715 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58042024-09-23T23:20:39.603ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45518
58052024-09-23T23:20:39.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45518 req_id = 3bf1a506-fdfc-4769-abfb-e6ac621dcc36 roles = RoleSet { roles: {} } uri = /metrics/producers
58062024-09-23T23:20:39.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45518 req_id = 3bf1a506-fdfc-4769-abfb-e6ac621dcc36 resource = Database result = Ok(()) uri = /metrics/producers
58072024-09-23T23:20:39.635ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
58082024-09-23T23:20:39.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45518 req_id = 3bf1a506-fdfc-4769-abfb-e6ac621dcc36 roles = RoleSet { roles: {} } uri = /metrics/producers
58092024-09-23T23:20:39.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45518 req_id = 3bf1a506-fdfc-4769-abfb-e6ac621dcc36 resource = Database result = Ok(()) uri = /metrics/producers
58102024-09-23T23:20:39.641ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
58112024-09-23T23:20:39.642ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0db845d9-af8b-4b5c-9e39-d7407d018d0b", "date": "Mon, 23 Sep 2024 23:20:39 GMT"} })
58122024-09-23T23:20:39.642ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = 09b2e92f-0f56-43ff-8e2a-6b0e41405076
58132024-09-23T23:20:39.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39984 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45518 req_id = 3bf1a506-fdfc-4769-abfb-e6ac621dcc36 response_code = 201 uri = /metrics/producers
58142024-09-23T23:20:39.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 23b1c578-6733-4539-8b9b-0b5d847ea4a5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58152024-09-23T23:20:39.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 23b1c578-6733-4539-8b9b-0b5d847ea4a5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58162024-09-23T23:20:39.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 23b1c578-6733-4539-8b9b-0b5d847ea4a5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58172024-09-23T23:20:40.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = baf2a0a2-1b73-47a6-8d68-9637708c23b7 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58182024-09-23T23:20:40.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = baf2a0a2-1b73-47a6-8d68-9637708c23b7 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58192024-09-23T23:20:40.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = baf2a0a2-1b73-47a6-8d68-9637708c23b7 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58202024-09-23T23:20:41.586ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:38100
58212024-09-23T23:20:41.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38100 req_id = 425d8466-15f7-46b8-b06c-81238aa1b45d roles = RoleSet { roles: {} } uri = /metrics/producers
58222024-09-23T23:20:41.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38100 req_id = 425d8466-15f7-46b8-b06c-81238aa1b45d resource = Database result = Ok(()) uri = /metrics/producers
58232024-09-23T23:20:41.620ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
58242024-09-23T23:20:41.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38100 req_id = 425d8466-15f7-46b8-b06c-81238aa1b45d roles = RoleSet { roles: {} } uri = /metrics/producers
58252024-09-23T23:20:41.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38100 req_id = 425d8466-15f7-46b8-b06c-81238aa1b45d resource = Database result = Ok(()) uri = /metrics/producers
58262024-09-23T23:20:41.651ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
58272024-09-23T23:20:41.652ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5fffffef-0e05-4982-a9f7-5ff8d012cbec", "date": "Mon, 23 Sep 2024 23:20:41 GMT"} })
58282024-09-23T23:20:41.652ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = a6cfeab5-1bcd-4180-8b80-d27bd607042d
58292024-09-23T23:20:41.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65840 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38100 req_id = 425d8466-15f7-46b8-b06c-81238aa1b45d response_code = 201 uri = /metrics/producers
58302024-09-23T23:20:41.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2c30f7c9-9015-46bf-a9a3-04e16ae0c08a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58312024-09-23T23:20:41.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2c30f7c9-9015-46bf-a9a3-04e16ae0c08a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58322024-09-23T23:20:41.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2c30f7c9-9015-46bf-a9a3-04e16ae0c08a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58332024-09-23T23:20:42.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 84c9c41d-0aee-499f-800f-a12724a5664e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58342024-09-23T23:20:42.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 84c9c41d-0aee-499f-800f-a12724a5664e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58352024-09-23T23:20:42.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 84c9c41d-0aee-499f-800f-a12724a5664e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58362024-09-23T23:20:43.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 513ace4d-fd6b-4d08-94bc-6e9d9075df1e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58372024-09-23T23:20:43.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 513ace4d-fd6b-4d08-94bc-6e9d9075df1e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58382024-09-23T23:20:43.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 513ace4d-fd6b-4d08-94bc-6e9d9075df1e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58392024-09-23T23:20:45.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bc8f9365-f49c-494a-aff1-fa7384e0082d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58402024-09-23T23:20:45.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bc8f9365-f49c-494a-aff1-fa7384e0082d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58412024-09-23T23:20:45.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bc8f9365-f49c-494a-aff1-fa7384e0082d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58422024-09-23T23:20:46.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68de2786-1df9-494e-85f0-5aa527d21454 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58432024-09-23T23:20:46.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68de2786-1df9-494e-85f0-5aa527d21454 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58442024-09-23T23:20:46.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68de2786-1df9-494e-85f0-5aa527d21454 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58452024-09-23T23:20:46.282ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = e52bfebc-15de-4693-8723-74afa5438ddd response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
58462024-09-23T23:20:47.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bf717880-8fd2-4c84-b515-6a589cfce286 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58472024-09-23T23:20:47.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bf717880-8fd2-4c84-b515-6a589cfce286 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58482024-09-23T23:20:47.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bf717880-8fd2-4c84-b515-6a589cfce286 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58492024-09-23T23:20:47.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
58502024-09-23T23:20:47.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58512024-09-23T23:20:47.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58522024-09-23T23:20:47.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
58532024-09-23T23:20:47.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58542024-09-23T23:20:47.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58552024-09-23T23:20:47.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58562024-09-23T23:20:47.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58572024-09-23T23:20:47.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58582024-09-23T23:20:47.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58592024-09-23T23:20:47.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58602024-09-23T23:20:47.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58612024-09-23T23:20:47.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58622024-09-23T23:20:47.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
58632024-09-23T23:20:47.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58642024-09-23T23:20:47.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58652024-09-23T23:20:47.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
58662024-09-23T23:20:47.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.169111ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
58672024-09-23T23:20:47.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58682024-09-23T23:20:47.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58692024-09-23T23:20:47.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.435917ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58702024-09-23T23:20:48.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d01ad9c6-aefc-4950-802a-cdf4b661eea3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58712024-09-23T23:20:48.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d01ad9c6-aefc-4950-802a-cdf4b661eea3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58722024-09-23T23:20:48.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = d01ad9c6-aefc-4950-802a-cdf4b661eea3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58732024-09-23T23:20:49.022ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38169
58742024-09-23T23:20:49.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38169 req_id = a8d3636b-9afe-4c12-b458-8be111144f49 roles = RoleSet { roles: {} } uri = /metrics/producers
58752024-09-23T23:20:49.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38169 req_id = a8d3636b-9afe-4c12-b458-8be111144f49 resource = Database result = Ok(()) uri = /metrics/producers
58762024-09-23T23:20:49.055ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
58772024-09-23T23:20:49.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38169 req_id = a8d3636b-9afe-4c12-b458-8be111144f49 roles = RoleSet { roles: {} } uri = /metrics/producers
58782024-09-23T23:20:49.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38169 req_id = a8d3636b-9afe-4c12-b458-8be111144f49 resource = Database result = Ok(()) uri = /metrics/producers
58792024-09-23T23:20:49.060ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
58802024-09-23T23:20:49.061ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "75d450da-8fda-4bfe-86c5-0e8a1b6cd1dc", "date": "Mon, 23 Sep 2024 23:20:49 GMT"} })
58812024-09-23T23:20:49.061ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = fd52d736-9d37-4f7f-81ce-c956fa9f23e3
58822024-09-23T23:20:49.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39286 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38169 req_id = a8d3636b-9afe-4c12-b458-8be111144f49 response_code = 201 uri = /metrics/producers
58832024-09-23T23:20:49.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 948b3953-de7d-455f-b6e9-50982ea3ba48 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58842024-09-23T23:20:49.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 948b3953-de7d-455f-b6e9-50982ea3ba48 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58852024-09-23T23:20:49.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 948b3953-de7d-455f-b6e9-50982ea3ba48 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58862024-09-23T23:20:49.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = e51daf2c-01d3-4a71-a815-28c63705e5a6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
58872024-09-23T23:20:49.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = e51daf2c-01d3-4a71-a815-28c63705e5a6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
58882024-09-23T23:20:49.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = e51daf2c-01d3-4a71-a815-28c63705e5a6 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
58892024-09-23T23:20:50.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e498363-ef4d-4ed0-99a3-0fdba71f1fd9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58902024-09-23T23:20:50.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e498363-ef4d-4ed0-99a3-0fdba71f1fd9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58912024-09-23T23:20:50.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e498363-ef4d-4ed0-99a3-0fdba71f1fd9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58922024-09-23T23:20:51.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 90cc255d-7671-4547-aedd-2bf7068c145e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58932024-09-23T23:20:51.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 90cc255d-7671-4547-aedd-2bf7068c145e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58942024-09-23T23:20:51.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 90cc255d-7671-4547-aedd-2bf7068c145e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58952024-09-23T23:20:52.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b725c3c0-272a-4353-a68c-31430aa91c0d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58962024-09-23T23:20:52.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b725c3c0-272a-4353-a68c-31430aa91c0d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58972024-09-23T23:20:52.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b725c3c0-272a-4353-a68c-31430aa91c0d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58982024-09-23T23:20:53.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 06d543a3-b30c-4a79-a940-cf45298a4627 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
58992024-09-23T23:20:53.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 06d543a3-b30c-4a79-a940-cf45298a4627 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59002024-09-23T23:20:53.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 06d543a3-b30c-4a79-a940-cf45298a4627 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59012024-09-23T23:20:54.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 44627220-97a3-4dcd-ac56-333ba5e8080f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59022024-09-23T23:20:54.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 44627220-97a3-4dcd-ac56-333ba5e8080f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59032024-09-23T23:20:54.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 44627220-97a3-4dcd-ac56-333ba5e8080f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59042024-09-23T23:20:55.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c6f5360f-837c-4842-ba07-5999bd3922fc roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59052024-09-23T23:20:55.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c6f5360f-837c-4842-ba07-5999bd3922fc resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59062024-09-23T23:20:55.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c6f5360f-837c-4842-ba07-5999bd3922fc response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59072024-09-23T23:20:56.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1827cdc8-0877-4dd7-9fd9-4462fd5e1b3c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59082024-09-23T23:20:56.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1827cdc8-0877-4dd7-9fd9-4462fd5e1b3c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59092024-09-23T23:20:56.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1827cdc8-0877-4dd7-9fd9-4462fd5e1b3c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59102024-09-23T23:20:56.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 0942d13a-2e39-4251-9612-7ae499bad681 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
59112024-09-23T23:20:56.884ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39545
59122024-09-23T23:20:56.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39545 req_id = c6d1d4e6-8fbb-4411-ac95-8b69a5a91d22 roles = RoleSet { roles: {} } uri = /metrics/producers
59132024-09-23T23:20:56.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39545 req_id = c6d1d4e6-8fbb-4411-ac95-8b69a5a91d22 resource = Database result = Ok(()) uri = /metrics/producers
59142024-09-23T23:20:56.916ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
59152024-09-23T23:20:56.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39545 req_id = c6d1d4e6-8fbb-4411-ac95-8b69a5a91d22 roles = RoleSet { roles: {} } uri = /metrics/producers
59162024-09-23T23:20:56.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39545 req_id = c6d1d4e6-8fbb-4411-ac95-8b69a5a91d22 resource = Database result = Ok(()) uri = /metrics/producers
59172024-09-23T23:20:56.924ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
59182024-09-23T23:20:56.924ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8b4e1146-f06a-4dd1-9ec5-83d0018bc50d", "date": "Mon, 23 Sep 2024 23:20:56 GMT"} })
59192024-09-23T23:20:56.924ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = c1c0a7ac-2dfc-4b9c-8213-1795864579b6
59202024-09-23T23:20:56.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41327 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39545 req_id = c6d1d4e6-8fbb-4411-ac95-8b69a5a91d22 response_code = 201 uri = /metrics/producers
59212024-09-23T23:20:57.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b79f1c73-e1b4-440d-bbfd-0a81bc12b4bb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59222024-09-23T23:20:57.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b79f1c73-e1b4-440d-bbfd-0a81bc12b4bb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59232024-09-23T23:20:57.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b79f1c73-e1b4-440d-bbfd-0a81bc12b4bb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59242024-09-23T23:20:57.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
59252024-09-23T23:20:57.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59262024-09-23T23:20:57.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59272024-09-23T23:20:57.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
59282024-09-23T23:20:57.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59292024-09-23T23:20:57.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59302024-09-23T23:20:57.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59312024-09-23T23:20:57.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59322024-09-23T23:20:57.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59332024-09-23T23:20:57.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.818452ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59342024-09-23T23:20:57.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59352024-09-23T23:20:57.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59362024-09-23T23:20:57.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59372024-09-23T23:20:57.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59382024-09-23T23:20:57.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59392024-09-23T23:20:57.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59402024-09-23T23:20:57.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
59412024-09-23T23:20:57.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59422024-09-23T23:20:57.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59432024-09-23T23:20:57.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
59442024-09-23T23:20:57.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.577221ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
59452024-09-23T23:20:58.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c9340850-00ff-425f-8ec9-aed50a3090f4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59462024-09-23T23:20:58.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c9340850-00ff-425f-8ec9-aed50a3090f4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59472024-09-23T23:20:58.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c9340850-00ff-425f-8ec9-aed50a3090f4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59482024-09-23T23:20:59.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = db37e723-85eb-4152-9f60-eac7dac58d77 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59492024-09-23T23:20:59.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = db37e723-85eb-4152-9f60-eac7dac58d77 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59502024-09-23T23:20:59.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = db37e723-85eb-4152-9f60-eac7dac58d77 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59512024-09-23T23:21:00.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bf8beacd-7c0f-420a-88c3-2ea30df485bc roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59522024-09-23T23:21:00.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bf8beacd-7c0f-420a-88c3-2ea30df485bc resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59532024-09-23T23:21:00.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = bf8beacd-7c0f-420a-88c3-2ea30df485bc response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59542024-09-23T23:21:01.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e6184364-e6f7-4e17-8b8c-95eeb86ef8a0 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59552024-09-23T23:21:01.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e6184364-e6f7-4e17-8b8c-95eeb86ef8a0 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59562024-09-23T23:21:01.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e6184364-e6f7-4e17-8b8c-95eeb86ef8a0 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59572024-09-23T23:21:02.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 44446bc2-9c06-4c17-860f-e932b1f083c5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59582024-09-23T23:21:02.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 44446bc2-9c06-4c17-860f-e932b1f083c5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59592024-09-23T23:21:02.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 44446bc2-9c06-4c17-860f-e932b1f083c5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59602024-09-23T23:21:03.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 04be0f45-05a2-4fea-acea-e409c2fed6ff roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59612024-09-23T23:21:03.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 04be0f45-05a2-4fea-acea-e409c2fed6ff resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59622024-09-23T23:21:03.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 04be0f45-05a2-4fea-acea-e409c2fed6ff response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59632024-09-23T23:21:04.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e1ba6d13-f5f5-4ef1-b484-e49e179e5598 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59642024-09-23T23:21:04.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e1ba6d13-f5f5-4ef1-b484-e49e179e5598 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59652024-09-23T23:21:04.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e1ba6d13-f5f5-4ef1-b484-e49e179e5598 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59662024-09-23T23:21:05.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9f2fa789-c250-4d72-9d1a-cc7a54de6246 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59672024-09-23T23:21:05.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9f2fa789-c250-4d72-9d1a-cc7a54de6246 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59682024-09-23T23:21:05.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9f2fa789-c250-4d72-9d1a-cc7a54de6246 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59692024-09-23T23:21:06.282ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1479 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = ef2e3722-cacf-410a-81aa-5c9e5bf3b5c4 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
59702024-09-23T23:21:06.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 97ed786b-2608-40cb-8442-6b7feafec6b3 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59712024-09-23T23:21:06.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 97ed786b-2608-40cb-8442-6b7feafec6b3 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59722024-09-23T23:21:06.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 97ed786b-2608-40cb-8442-6b7feafec6b3 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59732024-09-23T23:21:07.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 535264cb-667b-42f4-b1a9-46d3f3ab3c7b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59742024-09-23T23:21:07.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 535264cb-667b-42f4-b1a9-46d3f3ab3c7b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59752024-09-23T23:21:07.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 535264cb-667b-42f4-b1a9-46d3f3ab3c7b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
59762024-09-23T23:21:07.803ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
59772024-09-23T23:21:07.803ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59782024-09-23T23:21:07.803ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
59792024-09-23T23:21:07.803ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59802024-09-23T23:21:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59812024-09-23T23:21:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59822024-09-23T23:21:07.804ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
59832024-09-23T23:21:07.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
59842024-09-23T23:21:07.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59852024-09-23T23:21:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59862024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
59872024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
59882024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59892024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59902024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
59912024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59922024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
59932024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59942024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
59952024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59962024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
59972024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59982024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
59992024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
60002024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
60012024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60022024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60032024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60042024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
60052024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60062024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
60072024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60082024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60092024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60102024-09-23T23:21:07.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60112024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60122024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60132024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60142024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60152024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60162024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60172024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60182024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60192024-09-23T23:21:07.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 690296997 } })
60202024-09-23T23:21:07.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 690298637 } })
60212024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60222024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
60232024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
60242024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
60252024-09-23T23:21:07.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60262024-09-23T23:21:07.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
60272024-09-23T23:21:07.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
60282024-09-23T23:21:07.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60292024-09-23T23:21:07.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60302024-09-23T23:21:07.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60312024-09-23T23:21:07.807ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.843564ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60322024-09-23T23:21:07.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60332024-09-23T23:21:07.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60342024-09-23T23:21:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60352024-09-23T23:21:07.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60362024-09-23T23:21:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60372024-09-23T23:21:07.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60382024-09-23T23:21:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60392024-09-23T23:21:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60402024-09-23T23:21:07.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60412024-09-23T23:21:07.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60422024-09-23T23:21:07.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60432024-09-23T23:21:07.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60442024-09-23T23:21:07.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60452024-09-23T23:21:07.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.328076ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
60462024-09-23T23:21:07.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60472024-09-23T23:21:07.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60482024-09-23T23:21:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60492024-09-23T23:21:07.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60502024-09-23T23:21:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60512024-09-23T23:21:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60522024-09-23T23:21:07.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60532024-09-23T23:21:07.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60542024-09-23T23:21:07.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60552024-09-23T23:21:07.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60562024-09-23T23:21:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60572024-09-23T23:21:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60582024-09-23T23:21:07.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60592024-09-23T23:21:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60602024-09-23T23:21:07.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60612024-09-23T23:21:07.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60622024-09-23T23:21:07.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60632024-09-23T23:21:07.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60642024-09-23T23:21:07.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60652024-09-23T23:21:07.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60662024-09-23T23:21:07.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60672024-09-23T23:21:07.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 713740127 } })
60682024-09-23T23:21:07.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
60692024-09-23T23:21:07.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60702024-09-23T23:21:07.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60712024-09-23T23:21:07.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60722024-09-23T23:21:07.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60732024-09-23T23:21:07.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60742024-09-23T23:21:07.832ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60752024-09-23T23:21:07.832ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.396934ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60762024-09-23T23:21:07.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60772024-09-23T23:21:07.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60782024-09-23T23:21:07.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60792024-09-23T23:21:07.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60802024-09-23T23:21:07.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60812024-09-23T23:21:07.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60822024-09-23T23:21:07.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60832024-09-23T23:21:07.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60842024-09-23T23:21:07.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60852024-09-23T23:21:07.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60862024-09-23T23:21:07.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60872024-09-23T23:21:07.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60882024-09-23T23:21:07.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60892024-09-23T23:21:07.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60902024-09-23T23:21:07.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60912024-09-23T23:21:07.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60922024-09-23T23:21:07.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.500949ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
60932024-09-23T23:21:07.856ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60942024-09-23T23:21:07.856ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60952024-09-23T23:21:07.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60962024-09-23T23:21:07.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.576173ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60972024-09-23T23:21:07.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60982024-09-23T23:21:07.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60992024-09-23T23:21:07.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61002024-09-23T23:21:07.858ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61012024-09-23T23:21:07.858ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61022024-09-23T23:21:07.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61032024-09-23T23:21:07.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61042024-09-23T23:21:07.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.196366ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
61052024-09-23T23:21:07.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61062024-09-23T23:21:07.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61072024-09-23T23:21:07.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61082024-09-23T23:21:07.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61092024-09-23T23:21:07.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61102024-09-23T23:21:07.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
61112024-09-23T23:21:07.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61122024-09-23T23:21:07.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61132024-09-23T23:21:07.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61142024-09-23T23:21:07.875ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.35539ms iteration = 18 status = 0
61152024-09-23T23:21:07.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
61162024-09-23T23:21:07.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61172024-09-23T23:21:07.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61182024-09-23T23:21:07.879ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.76453ms iteration = 21 status = {"physical_disks_added":0}
61192024-09-23T23:21:07.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
61202024-09-23T23:21:07.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.97803ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
61212024-09-23T23:21:07.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.454011ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
61222024-09-23T23:21:07.888ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61232024-09-23T23:21:07.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61242024-09-23T23:21:07.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.691484ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
61252024-09-23T23:21:07.895ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
61262024-09-23T23:21:07.895ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61272024-09-23T23:21:07.895ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83e91cf6-3f41-4511-a33c-f67d8a1544ff", "content-length": "26", "date": "Mon, 23 Sep 2024 23:21:07 GMT"} })
61282024-09-23T23:21:07.895ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61292024-09-23T23:21:07.898ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61302024-09-23T23:21:07.898ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61312024-09-23T23:21:07.898ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61322024-09-23T23:21:07.898ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.443846ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61332024-09-23T23:21:08.014ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
61342024-09-23T23:21:08.014ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61352024-09-23T23:21:08.015ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e977df3-5953-4d00-a506-c3fd8ef23a8c", "content-length": "26", "date": "Mon, 23 Sep 2024 23:21:07 GMT"} })
61362024-09-23T23:21:08.015ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61372024-09-23T23:21:08.017ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61382024-09-23T23:21:08.020ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61392024-09-23T23:21:08.027ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
61402024-09-23T23:21:08.028ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0e6e1e71-6d5b-49f0-9698-aae33b84458e", "content-length": "2", "date": "Mon, 23 Sep 2024 23:21:07 GMT"} })
61412024-09-23T23:21:08.029ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61422024-09-23T23:21:08.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61432024-09-23T23:21:08.034ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 231.330316ms iteration = 18 status = null
61442024-09-23T23:21:08.039ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
61452024-09-23T23:21:08.039ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61462024-09-23T23:21:08.039ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ee246c2d-7031-42a7-aa15-18785c204f44", "content-length": "26", "date": "Mon, 23 Sep 2024 23:21:07 GMT"} })
61472024-09-23T23:21:08.039ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61482024-09-23T23:21:08.041ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
61492024-09-23T23:21:08.054ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61502024-09-23T23:21:08.093ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 290.099333ms iteration = 18 status = {}
61512024-09-23T23:21:08.116ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "148a5ade-8e85-4aed-a163-ffaf9ac76d5d", "content-length": "372", "date": "Mon, 23 Sep 2024 23:21:08 GMT"} })
61522024-09-23T23:21:08.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61532024-09-23T23:21:08.116ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d66b5f8e-bdbc-4bd8-97c5-148a91c09473", "content-length": "691", "date": "Mon, 23 Sep 2024 23:21:08 GMT"} })
61542024-09-23T23:21:08.116ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
61552024-09-23T23:21:08.116ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
61562024-09-23T23:21:08.116ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
61572024-09-23T23:21:08.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61582024-09-23T23:21:08.117ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 312.135887ms iteration = 19 status = {}
61592024-09-23T23:21:08.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61602024-09-23T23:21:08.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61612024-09-23T23:21:08.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61622024-09-23T23:21:08.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61632024-09-23T23:21:08.124ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61642024-09-23T23:21:08.125ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3162f382-90c5-44b5-b7b5-3d41d98464ee", "date": "Mon, 23 Sep 2024 23:21:07 GMT"} })
61652024-09-23T23:21:08.127ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 321.751498ms iteration = 20 status = {}
61662024-09-23T23:21:08.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61672024-09-23T23:21:08.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61682024-09-23T23:21:08.164ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
61692024-09-23T23:21:08.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61702024-09-23T23:21:08.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61712024-09-23T23:21:08.173ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61722024-09-23T23:21:08.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "721bd5b2-ae35-4ec0-8c9d-fbd357330c19", "content-length": "121", "date": "Mon, 23 Sep 2024 23:21:08 GMT"} })
61732024-09-23T23:21:08.174ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
61742024-09-23T23:21:08.174ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
61752024-09-23T23:21:08.174ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61762024-09-23T23:21:08.174ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61772024-09-23T23:21:08.174ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
61782024-09-23T23:21:08.174ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
61792024-09-23T23:21:08.174ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
61802024-09-23T23:21:08.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61812024-09-23T23:21:08.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61822024-09-23T23:21:08.175ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61832024-09-23T23:21:08.175ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9909b848-a6be-467b-b7ea-e95dcf5818ab", "content-length": "2", "date": "Mon, 23 Sep 2024 23:21:08 GMT"} })
61842024-09-23T23:21:08.176ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61852024-09-23T23:21:08.176ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "84fd7112-5a33-431b-93cc-c7f22635628f", "content-length": "52", "date": "Mon, 23 Sep 2024 23:21:08 GMT"} })
61862024-09-23T23:21:08.176ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
61872024-09-23T23:21:08.176ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61882024-09-23T23:21:08.273ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cebd4913-94e4-4645-90f4-2dbd6c38b20a", "date": "Mon, 23 Sep 2024 23:21:07 GMT"} })
61892024-09-23T23:21:08.273ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
61902024-09-23T23:21:08.273ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61912024-09-23T23:21:08.274ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0655363d-a4d3-4c2d-8ac1-11a281f603f4", "content-length": "667", "date": "Mon, 23 Sep 2024 23:21:08 GMT"} })
61922024-09-23T23:21:08.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61932024-09-23T23:21:08.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61942024-09-23T23:21:08.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61952024-09-23T23:21:08.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61962024-09-23T23:21:08.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61972024-09-23T23:21:08.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61982024-09-23T23:21:08.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61992024-09-23T23:21:08.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62002024-09-23T23:21:08.289ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 483.916786ms iteration = 18 status = {}
62012024-09-23T23:21:08.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 37125090-9208-4af2-bd7f-f81ae65cc923 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62022024-09-23T23:21:08.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 37125090-9208-4af2-bd7f-f81ae65cc923 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62032024-09-23T23:21:08.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 37125090-9208-4af2-bd7f-f81ae65cc923 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62042024-09-23T23:21:09.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 79f4b943-2ed8-4e61-879d-1dc4a1ee889f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62052024-09-23T23:21:09.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 79f4b943-2ed8-4e61-879d-1dc4a1ee889f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62062024-09-23T23:21:09.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 79f4b943-2ed8-4e61-879d-1dc4a1ee889f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62072024-09-23T23:21:10.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 543ba302-4850-45b3-ad63-2ff9320791a4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62082024-09-23T23:21:10.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 543ba302-4850-45b3-ad63-2ff9320791a4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62092024-09-23T23:21:10.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 543ba302-4850-45b3-ad63-2ff9320791a4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62102024-09-23T23:21:11.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 15dc8a16-1570-40b6-a6dc-9f75b8965b12 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62112024-09-23T23:21:11.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 15dc8a16-1570-40b6-a6dc-9f75b8965b12 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62122024-09-23T23:21:11.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 15dc8a16-1570-40b6-a6dc-9f75b8965b12 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62132024-09-23T23:21:12.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8d90b445-e132-4eff-965f-a78c4ef2a160 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62142024-09-23T23:21:12.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8d90b445-e132-4eff-965f-a78c4ef2a160 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62152024-09-23T23:21:12.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 8d90b445-e132-4eff-965f-a78c4ef2a160 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62162024-09-23T23:21:13.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5589ffee-f17f-4a00-8b5b-5bc435ddd5bd roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62172024-09-23T23:21:13.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5589ffee-f17f-4a00-8b5b-5bc435ddd5bd resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62182024-09-23T23:21:13.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5589ffee-f17f-4a00-8b5b-5bc435ddd5bd response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62192024-09-23T23:21:14.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 46c09fe1-7a1e-446c-8c6b-b4570342f0d2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62202024-09-23T23:21:14.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 46c09fe1-7a1e-446c-8c6b-b4570342f0d2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62212024-09-23T23:21:14.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 46c09fe1-7a1e-446c-8c6b-b4570342f0d2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62222024-09-23T23:21:15.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5f0a80c-464e-4fa7-88f7-a3d4b7568a0d roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62232024-09-23T23:21:15.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5f0a80c-464e-4fa7-88f7-a3d4b7568a0d resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62242024-09-23T23:21:15.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c5f0a80c-464e-4fa7-88f7-a3d4b7568a0d response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62252024-09-23T23:21:16.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1372 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 491c1cfa-9fbe-4b3c-b9e4-08ff9dd263b8 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
62262024-09-23T23:21:16.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 778f0455-e163-4c0d-a8d3-fa4e70a5aaf8 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62272024-09-23T23:21:16.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 778f0455-e163-4c0d-a8d3-fa4e70a5aaf8 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62282024-09-23T23:21:16.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 778f0455-e163-4c0d-a8d3-fa4e70a5aaf8 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62292024-09-23T23:21:16.959ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:37942
62302024-09-23T23:21:16.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37942 req_id = c8852b1c-5fa5-4b49-bc52-9a58861b19c6 roles = RoleSet { roles: {} } uri = /metrics/producers
62312024-09-23T23:21:16.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37942 req_id = c8852b1c-5fa5-4b49-bc52-9a58861b19c6 resource = Database result = Ok(()) uri = /metrics/producers
62322024-09-23T23:21:16.993ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
62332024-09-23T23:21:16.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37942 req_id = c8852b1c-5fa5-4b49-bc52-9a58861b19c6 roles = RoleSet { roles: {} } uri = /metrics/producers
62342024-09-23T23:21:16.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37942 req_id = c8852b1c-5fa5-4b49-bc52-9a58861b19c6 resource = Database result = Ok(()) uri = /metrics/producers
62352024-09-23T23:21:16.999ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
62362024-09-23T23:21:17.000ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ff00b004-a181-44b2-87ef-4f90935ed025", "date": "Mon, 23 Sep 2024 23:21:16 GMT"} })
62372024-09-23T23:21:17.000ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = ac854ddf-1dd0-4658-bc1c-106b334d06aa
62382024-09-23T23:21:17.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41889 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37942 req_id = c8852b1c-5fa5-4b49-bc52-9a58861b19c6 response_code = 201 uri = /metrics/producers
62392024-09-23T23:21:17.296ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39469
62402024-09-23T23:21:17.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39469 req_id = 1edefab9-db1d-4b97-88ff-f7015e447beb roles = RoleSet { roles: {} } uri = /metrics/producers
62412024-09-23T23:21:17.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39469 req_id = 1edefab9-db1d-4b97-88ff-f7015e447beb resource = Database result = Ok(()) uri = /metrics/producers
62422024-09-23T23:21:17.330ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b1b00c55-180a-49a6-8247-29e381ecf42d
62432024-09-23T23:21:17.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39469 req_id = 1edefab9-db1d-4b97-88ff-f7015e447beb roles = RoleSet { roles: {} } uri = /metrics/producers
62442024-09-23T23:21:17.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39469 req_id = 1edefab9-db1d-4b97-88ff-f7015e447beb resource = Database result = Ok(()) uri = /metrics/producers
62452024-09-23T23:21:17.364ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d uri = http://[fd00:1122:3344:101::d]:12223/producers
62462024-09-23T23:21:17.365ZDEBGnexus: client response oximeter-collector = b1b00c55-180a-49a6-8247-29e381ecf42d result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b9c70808-bcb3-4a10-9def-841dee7e44d8", "date": "Mon, 23 Sep 2024 23:21:16 GMT"} })
62472024-09-23T23:21:17.365ZINFOnexus: assigned collector to new producer collector_id = b1b00c55-180a-49a6-8247-29e381ecf42d file = nexus/src/app/oximeter.rs:125 producer_id = 33a0a3ef-fb4e-4eb6-bc0e-5a150e0c94ea
62482024-09-23T23:21:17.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 70137 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39469 req_id = 1edefab9-db1d-4b97-88ff-f7015e447beb response_code = 201 uri = /metrics/producers
62492024-09-23T23:21:17.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e959479a-bd56-4785-89b3-fd6c1e7382ab roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62502024-09-23T23:21:17.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e959479a-bd56-4785-89b3-fd6c1e7382ab resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62512024-09-23T23:21:17.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e959479a-bd56-4785-89b3-fd6c1e7382ab response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62522024-09-23T23:21:17.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
62532024-09-23T23:21:17.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62542024-09-23T23:21:17.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62552024-09-23T23:21:17.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62562024-09-23T23:21:17.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
62572024-09-23T23:21:17.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62582024-09-23T23:21:17.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62592024-09-23T23:21:17.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62602024-09-23T23:21:17.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62612024-09-23T23:21:17.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62622024-09-23T23:21:17.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62632024-09-23T23:21:17.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62642024-09-23T23:21:17.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.813794ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62652024-09-23T23:21:17.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62662024-09-23T23:21:17.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62672024-09-23T23:21:17.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62682024-09-23T23:21:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
62692024-09-23T23:21:17.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62702024-09-23T23:21:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62712024-09-23T23:21:17.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
62722024-09-23T23:21:17.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.30627ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
62732024-09-23T23:21:18.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 48914867-00ee-4917-9a7d-61a523be3c02 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62742024-09-23T23:21:18.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 48914867-00ee-4917-9a7d-61a523be3c02 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62752024-09-23T23:21:18.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 48914867-00ee-4917-9a7d-61a523be3c02 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62762024-09-23T23:21:19.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 849b7a5c-2573-41c1-a746-a4a1abdeb769 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62772024-09-23T23:21:19.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 849b7a5c-2573-41c1-a746-a4a1abdeb769 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62782024-09-23T23:21:19.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 849b7a5c-2573-41c1-a746-a4a1abdeb769 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62792024-09-23T23:21:19.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 07a293ce-4fca-45ca-b7f8-deb4c9966384 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
62802024-09-23T23:21:19.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 07a293ce-4fca-45ca-b7f8-deb4c9966384 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
62812024-09-23T23:21:19.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 07a293ce-4fca-45ca-b7f8-deb4c9966384 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
62822024-09-23T23:21:20.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fe97f162-465c-4c25-af7f-0096702de37f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62832024-09-23T23:21:20.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fe97f162-465c-4c25-af7f-0096702de37f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62842024-09-23T23:21:20.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fe97f162-465c-4c25-af7f-0096702de37f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62852024-09-23T23:21:21.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 210554c4-e508-4703-b084-1d99f5432c7c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62862024-09-23T23:21:21.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 210554c4-e508-4703-b084-1d99f5432c7c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62872024-09-23T23:21:21.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 210554c4-e508-4703-b084-1d99f5432c7c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62882024-09-23T23:21:22.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9a25470a-91ee-4752-ae15-00fa0a978396 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62892024-09-23T23:21:22.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9a25470a-91ee-4752-ae15-00fa0a978396 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62902024-09-23T23:21:22.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9a25470a-91ee-4752-ae15-00fa0a978396 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62912024-09-23T23:21:23.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ff7735a8-1847-4740-b6c0-70737a66ad36 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62922024-09-23T23:21:23.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ff7735a8-1847-4740-b6c0-70737a66ad36 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62932024-09-23T23:21:23.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2556 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ff7735a8-1847-4740-b6c0-70737a66ad36 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62942024-09-23T23:21:24.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 671cc749-10d0-42ef-964d-153eab96e3f5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62952024-09-23T23:21:24.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 671cc749-10d0-42ef-964d-153eab96e3f5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62962024-09-23T23:21:24.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 671cc749-10d0-42ef-964d-153eab96e3f5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62972024-09-23T23:21:25.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1475ab2d-435a-49df-b52b-b233ae8075a8 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62982024-09-23T23:21:25.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1475ab2d-435a-49df-b52b-b233ae8075a8 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
62992024-09-23T23:21:25.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 1475ab2d-435a-49df-b52b-b233ae8075a8 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63002024-09-23T23:21:26.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 8428550c-e9c0-4466-942c-edaa10539f20 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
63012024-09-23T23:21:26.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 02168e1f-72ac-439c-8582-665f937c4f76 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63022024-09-23T23:21:26.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 02168e1f-72ac-439c-8582-665f937c4f76 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63032024-09-23T23:21:26.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 02168e1f-72ac-439c-8582-665f937c4f76 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63042024-09-23T23:21:27.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
63052024-09-23T23:21:27.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63062024-09-23T23:21:27.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63072024-09-23T23:21:27.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
63082024-09-23T23:21:27.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63092024-09-23T23:21:27.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63102024-09-23T23:21:27.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63112024-09-23T23:21:27.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63122024-09-23T23:21:27.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63132024-09-23T23:21:27.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63142024-09-23T23:21:27.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63152024-09-23T23:21:27.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63162024-09-23T23:21:27.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.664883ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63172024-09-23T23:21:27.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63182024-09-23T23:21:27.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63192024-09-23T23:21:27.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63202024-09-23T23:21:27.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
63212024-09-23T23:21:27.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63222024-09-23T23:21:27.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63232024-09-23T23:21:27.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
63242024-09-23T23:21:27.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.255179ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
63252024-09-23T23:21:27.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3106e163-b2a8-4f71-8659-e265929c9a83 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63262024-09-23T23:21:27.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3106e163-b2a8-4f71-8659-e265929c9a83 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63272024-09-23T23:21:27.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3106e163-b2a8-4f71-8659-e265929c9a83 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63282024-09-23T23:21:28.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 458378fd-176e-46cb-9424-b708eb350acf roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63292024-09-23T23:21:28.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 458378fd-176e-46cb-9424-b708eb350acf resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63302024-09-23T23:21:28.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 458378fd-176e-46cb-9424-b708eb350acf response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63312024-09-23T23:21:29.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e42cc761-9b61-4bca-bb74-7f1c9ba5f008 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63322024-09-23T23:21:29.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e42cc761-9b61-4bca-bb74-7f1c9ba5f008 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63332024-09-23T23:21:29.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e42cc761-9b61-4bca-bb74-7f1c9ba5f008 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63342024-09-23T23:21:31.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 16d751e1-f566-44e8-bf75-441785600eef roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63352024-09-23T23:21:31.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 16d751e1-f566-44e8-bf75-441785600eef resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63362024-09-23T23:21:31.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 16d751e1-f566-44e8-bf75-441785600eef response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63372024-09-23T23:21:32.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 228a3d56-9c1b-409a-9abc-8e27e3d339a4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63382024-09-23T23:21:32.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 228a3d56-9c1b-409a-9abc-8e27e3d339a4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63392024-09-23T23:21:32.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 228a3d56-9c1b-409a-9abc-8e27e3d339a4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63402024-09-23T23:21:33.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4830a45b-9642-440f-8e37-5992d194dbce roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63412024-09-23T23:21:33.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4830a45b-9642-440f-8e37-5992d194dbce resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63422024-09-23T23:21:33.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4830a45b-9642-440f-8e37-5992d194dbce response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63432024-09-23T23:21:34.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3f00c536-1069-491e-8e35-517f299fb294 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63442024-09-23T23:21:34.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3f00c536-1069-491e-8e35-517f299fb294 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63452024-09-23T23:21:34.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3f00c536-1069-491e-8e35-517f299fb294 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63462024-09-23T23:21:35.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 45e04f81-d400-4192-bb31-5af0aee0651e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63472024-09-23T23:21:35.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 45e04f81-d400-4192-bb31-5af0aee0651e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63482024-09-23T23:21:35.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 45e04f81-d400-4192-bb31-5af0aee0651e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63492024-09-23T23:21:36.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fbd772e8-987a-4194-af36-6b180ae49feb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63502024-09-23T23:21:36.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fbd772e8-987a-4194-af36-6b180ae49feb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63512024-09-23T23:21:36.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = fbd772e8-987a-4194-af36-6b180ae49feb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63522024-09-23T23:21:36.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2605 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = c608bc1b-4bbf-41e8-8bc6-11fe331fb94f response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
63532024-09-23T23:21:37.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b869fe23-cfe4-4f39-b076-6b5eb586202a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63542024-09-23T23:21:37.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b869fe23-cfe4-4f39-b076-6b5eb586202a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63552024-09-23T23:21:37.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b869fe23-cfe4-4f39-b076-6b5eb586202a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
63562024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
63572024-09-23T23:21:37.803ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-23 23:11:37.802994916 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
63582024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
63592024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
63602024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63612024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
63622024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
63632024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
63642024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
63652024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
63662024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63672024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
63682024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
63692024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
63702024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63712024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
63722024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63732024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
63742024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63752024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
63762024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63772024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63782024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63792024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
63802024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
63812024-09-23T23:21:37.803ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82
63822024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63832024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
63842024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.73\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82"}
63852024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63862024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63872024-09-23T23:21:37.803ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65799211-2178-4ef6-a14b-629ea048347e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2729181-3180-4ecf-bd42-a48f1144b71d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c86c6776-f22d-4b00-9f43-3c9b9c343289.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 687700987 } })
63882024-09-23T23:21:37.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63892024-09-23T23:21:37.804ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
63902024-09-23T23:21:37.804ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63912024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63922024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63932024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63942024-09-23T23:21:37.805ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("954a3d10-a2dd-433b-9252-ede695863bda.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e3d8dede-8980-4764-ac40-c508c2ebab6c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 689134473 } })
63952024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63962024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63972024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63982024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63992024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64002024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
64012024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64022024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
64032024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64042024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64052024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64062024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
64072024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
64082024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64092024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64102024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
64112024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
64122024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64132024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64142024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
64152024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64162024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
64172024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64182024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64192024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
64202024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
64212024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
64222024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64232024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
64242024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
64252024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
64262024-09-23T23:21:37.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64272024-09-23T23:21:37.805ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
64282024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.839633ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
64292024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64302024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
64312024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
64322024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
64332024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64342024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
64352024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64362024-09-23T23:21:37.806ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-23 23:11:37.802994916 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
64372024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.995274ms iteration = 10 status = {"expiration":"2024-09-23T23:11:37.802994916Z","pruned":[]}
64382024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64392024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64402024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64412024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64422024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64432024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64442024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64452024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64462024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64472024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64482024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64492024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64502024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64512024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
64522024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
64532024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64542024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64552024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
64562024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
64572024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64582024-09-23T23:21:37.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64592024-09-23T23:21:37.807ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
64602024-09-23T23:21:37.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 690971115 } })
64612024-09-23T23:21:37.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.003196ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
64622024-09-23T23:21:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64632024-09-23T23:21:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64642024-09-23T23:21:37.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64652024-09-23T23:21:37.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64662024-09-23T23:21:37.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
64672024-09-23T23:21:37.808ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 692371691 } })
64682024-09-23T23:21:37.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64692024-09-23T23:21:37.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64702024-09-23T23:21:37.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64712024-09-23T23:21:37.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64722024-09-23T23:21:37.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.465483ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64732024-09-23T23:21:37.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
64742024-09-23T23:21:37.810ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64752024-09-23T23:21:37.811ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64762024-09-23T23:21:37.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64772024-09-23T23:21:37.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64782024-09-23T23:21:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64792024-09-23T23:21:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64802024-09-23T23:21:37.812ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64812024-09-23T23:21:37.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64822024-09-23T23:21:37.812ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64832024-09-23T23:21:37.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.501378ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
64842024-09-23T23:21:37.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64852024-09-23T23:21:37.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64862024-09-23T23:21:37.814ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64872024-09-23T23:21:37.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64882024-09-23T23:21:37.815ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64892024-09-23T23:21:37.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64902024-09-23T23:21:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64912024-09-23T23:21:37.818ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64922024-09-23T23:21:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64932024-09-23T23:21:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64942024-09-23T23:21:37.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64952024-09-23T23:21:37.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64962024-09-23T23:21:37.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64972024-09-23T23:21:37.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64982024-09-23T23:21:37.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64992024-09-23T23:21:37.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65002024-09-23T23:21:37.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65012024-09-23T23:21:37.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65022024-09-23T23:21:37.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65032024-09-23T23:21:37.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65042024-09-23T23:21:37.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65052024-09-23T23:21:37.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65062024-09-23T23:21:37.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65072024-09-23T23:21:37.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65082024-09-23T23:21:37.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65092024-09-23T23:21:37.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65102024-09-23T23:21:37.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65112024-09-23T23:21:37.824ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65122024-09-23T23:21:37.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65132024-09-23T23:21:37.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65142024-09-23T23:21:37.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65152024-09-23T23:21:37.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65162024-09-23T23:21:37.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65172024-09-23T23:21:37.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65182024-09-23T23:21:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65192024-09-23T23:21:37.827ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65202024-09-23T23:21:37.827ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.66929ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
65212024-09-23T23:21:37.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65222024-09-23T23:21:37.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65232024-09-23T23:21:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65242024-09-23T23:21:37.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65252024-09-23T23:21:37.828ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
65262024-09-23T23:21:37.828ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
65272024-09-23T23:21:37.828ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 22.426248ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
65282024-09-23T23:21:37.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65292024-09-23T23:21:37.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65302024-09-23T23:21:37.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65312024-09-23T23:21:37.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65322024-09-23T23:21:37.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65332024-09-23T23:21:37.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65342024-09-23T23:21:37.834ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
65352024-09-23T23:21:37.834ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
65362024-09-23T23:21:37.834ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
65372024-09-23T23:21:37.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65382024-09-23T23:21:37.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65392024-09-23T23:21:37.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65402024-09-23T23:21:37.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65412024-09-23T23:21:37.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65422024-09-23T23:21:37.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65432024-09-23T23:21:37.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 32.304012ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
65442024-09-23T23:21:37.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65452024-09-23T23:21:37.841ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65462024-09-23T23:21:37.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65472024-09-23T23:21:37.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65482024-09-23T23:21:37.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65492024-09-23T23:21:37.845ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
65502024-09-23T23:21:37.845ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
65512024-09-23T23:21:37.845ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
65522024-09-23T23:21:37.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65532024-09-23T23:21:37.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
65542024-09-23T23:21:37.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65552024-09-23T23:21:37.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65562024-09-23T23:21:37.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65572024-09-23T23:21:37.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65582024-09-23T23:21:37.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65592024-09-23T23:21:37.848ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 732121389 } })
65602024-09-23T23:21:37.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65612024-09-23T23:21:37.848ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65622024-09-23T23:21:37.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65632024-09-23T23:21:37.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65642024-09-23T23:21:37.848ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
65652024-09-23T23:21:37.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65662024-09-23T23:21:37.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65672024-09-23T23:21:37.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65682024-09-23T23:21:37.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65692024-09-23T23:21:37.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65702024-09-23T23:21:37.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65712024-09-23T23:21:37.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65722024-09-23T23:21:37.867ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65732024-09-23T23:21:37.867ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65742024-09-23T23:21:37.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65752024-09-23T23:21:37.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65762024-09-23T23:21:37.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65772024-09-23T23:21:37.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.682012ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
65782024-09-23T23:21:37.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65792024-09-23T23:21:37.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65802024-09-23T23:21:37.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65812024-09-23T23:21:37.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65822024-09-23T23:21:37.876ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
65832024-09-23T23:21:37.876ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
65842024-09-23T23:21:37.876ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.976468ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
65852024-09-23T23:21:37.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.679658ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65862024-09-23T23:21:37.878ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65872024-09-23T23:21:37.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65882024-09-23T23:21:37.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65892024-09-23T23:21:37.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65902024-09-23T23:21:37.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65912024-09-23T23:21:37.887ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65922024-09-23T23:21:37.887ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.443999ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65932024-09-23T23:21:37.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
65942024-09-23T23:21:37.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65952024-09-23T23:21:37.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65962024-09-23T23:21:37.903ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
65972024-09-23T23:21:37.903ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 97.256911ms iteration = 10 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
65982024-09-23T23:21:37.941ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
65992024-09-23T23:21:37.951ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
66002024-09-23T23:21:37.983ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
66012024-09-23T23:21:37.983ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66022024-09-23T23:21:37.984ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d1723204-bee4-42ca-ac9f-9aeceaebac45", "content-length": "26", "date": "Mon, 23 Sep 2024 23:21:37 GMT"} })
66032024-09-23T23:21:37.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66042024-09-23T23:21:37.987ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66052024-09-23T23:21:38.003ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
66062024-09-23T23:21:38.003ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66072024-09-23T23:21:38.003ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1a3024ab-9d05-41c2-ab6c-703ac86f3a57", "content-length": "26", "date": "Mon, 23 Sep 2024 23:21:37 GMT"} })
66082024-09-23T23:21:38.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66092024-09-23T23:21:38.005ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66102024-09-23T23:21:38.036ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66112024-09-23T23:21:38.037ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "009d228a-8446-48b6-8080-cc00b92d811d", "content-length": "372", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} })
66122024-09-23T23:21:38.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66132024-09-23T23:21:38.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66142024-09-23T23:21:38.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66152024-09-23T23:21:38.039ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
66162024-09-23T23:21:38.039ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66172024-09-23T23:21:38.039ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 234.816866ms iteration = 5 status = {"nsuccess":5}
66182024-09-23T23:21:38.039ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6244c94d-937e-4584-a88a-8ed20824ebfd", "content-length": "26", "date": "Mon, 23 Sep 2024 23:21:37 GMT"} })
66192024-09-23T23:21:38.039ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66202024-09-23T23:21:38.042ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66212024-09-23T23:21:38.042ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66222024-09-23T23:21:38.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66232024-09-23T23:21:38.042ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
66242024-09-23T23:21:38.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66252024-09-23T23:21:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66262024-09-23T23:21:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66272024-09-23T23:21:38.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66282024-09-23T23:21:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66292024-09-23T23:21:38.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66302024-09-23T23:21:38.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66312024-09-23T23:21:38.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66322024-09-23T23:21:38.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66332024-09-23T23:21:38.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66342024-09-23T23:21:38.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66352024-09-23T23:21:38.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
66362024-09-23T23:21:38.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66372024-09-23T23:21:38.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66382024-09-23T23:21:38.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66392024-09-23T23:21:38.053ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 247.878697ms iteration = 19 status = 0
66402024-09-23T23:21:38.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66412024-09-23T23:21:38.055ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
66422024-09-23T23:21:38.055ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 251.5693ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
66432024-09-23T23:21:38.057ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66442024-09-23T23:21:38.058ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1bc2728b-2c4a-488c-ba2e-247b3bdba8b1", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} })
66452024-09-23T23:21:38.060ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 254.17197ms iteration = 21 status = {}
66462024-09-23T23:21:38.078ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
66472024-09-23T23:21:38.078ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
66482024-09-23T23:21:38.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66492024-09-23T23:21:38.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66502024-09-23T23:21:38.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 274.841957ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66512024-09-23T23:21:38.082ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66522024-09-23T23:21:38.082ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66532024-09-23T23:21:38.082ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 276.241034ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66542024-09-23T23:21:38.083ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66552024-09-23T23:21:38.083ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 0 version = 2
66562024-09-23T23:21:38.083ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66572024-09-23T23:21:38.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66582024-09-23T23:21:38.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66592024-09-23T23:21:38.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66602024-09-23T23:21:38.087ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66612024-09-23T23:21:38.087ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66622024-09-23T23:21:38.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66632024-09-23T23:21:38.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66642024-09-23T23:21:38.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66652024-09-23T23:21:38.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66662024-09-23T23:21:38.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 283.004451ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
66672024-09-23T23:21:38.091ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 8ad16dbb-cdd4-4ab2-87d2-5bc69ab9d2c9 dns_zone_name = oxide.test found_so_far = 1 version = 2
66682024-09-23T23:21:38.091ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
66692024-09-23T23:21:38.091ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-23 23:12:40.294485 UTC dns_group = external generation = 2
66702024-09-23T23:21:38.091ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 287.969219ms iteration = 11 status = {"generation":2}
66712024-09-23T23:21:38.112ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
66722024-09-23T23:21:38.112ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "17581910-7c77-400e-a4ba-a1e3b0724ab6", "date": "Mon, 23 Sep 2024 23:21:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66732024-09-23T23:21:38.112ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66742024-09-23T23:21:38.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66752024-09-23T23:21:38.114ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c4822c77-eab1-4a4b-83ae-4987c755e717", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66762024-09-23T23:21:38.114ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66772024-09-23T23:21:38.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66782024-09-23T23:21:38.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66792024-09-23T23:21:38.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66802024-09-23T23:21:38.117ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
66812024-09-23T23:21:38.117ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 314.035089ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
66822024-09-23T23:21:38.119ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6c33c3b6-0d97-408f-8dae-c3d552ed44ba dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
66832024-09-23T23:21:38.119ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
66842024-09-23T23:21:38.119ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-23 23:12:39.428682 UTC dns_group = internal generation = 1
66852024-09-23T23:21:38.119ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 316.248094ms iteration = 11 status = {"generation":1}
66862024-09-23T23:21:38.144ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-23T23:12:36.221760Z, time_modified: 2024-09-23T23:12:36.221760Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, db_silo: Silo { identity: SiloIdentity { id: 991d1ba4-4b68-4c37-85c3-fa3cf0f320b6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-23T23:12:40.254047Z, time_modified: 2024-09-23T23:12:40.254047Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613" }] }) }
66872024-09-23T23:21:38.144ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 341.01253ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]}},"default_endpoint":{"silo_id":"991d1ba4-4b68-4c37-85c3-fa3cf0f320b6","tls_certs":["75d33e531b1afa443b54e107c50926585bdb4a04f58487a44003d5bc47e1a613"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
66882024-09-23T23:21:38.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66892024-09-23T23:21:38.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66902024-09-23T23:21:38.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66912024-09-23T23:21:38.155ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 349.616279ms iteration = 22 status = {"physical_disks_added":0}
66922024-09-23T23:21:38.156ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66932024-09-23T23:21:38.156ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66942024-09-23T23:21:38.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66952024-09-23T23:21:38.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66962024-09-23T23:21:38.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66972024-09-23T23:21:38.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66982024-09-23T23:21:38.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66992024-09-23T23:21:38.170ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67002024-09-23T23:21:38.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = af0372b6-bd28-47a9-86a2-17e03769d403 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67012024-09-23T23:21:38.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = af0372b6-bd28-47a9-86a2-17e03769d403 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67022024-09-23T23:21:38.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = af0372b6-bd28-47a9-86a2-17e03769d403 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67032024-09-23T23:21:38.184ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 381.289364ms iteration = 19 status = {}
67042024-09-23T23:21:38.184ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67052024-09-23T23:21:38.185ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "acbf04fa-5fc1-49e2-b37a-9003c226b1b3", "content-length": "2", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} })
67062024-09-23T23:21:38.187ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67072024-09-23T23:21:38.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67082024-09-23T23:21:38.189ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 386.057989ms iteration = 19 status = null
67092024-09-23T23:21:38.321ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67102024-09-23T23:21:38.338ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
67112024-09-23T23:21:38.338ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8eaf04a5-575c-45f9-b942-b8419c5cb98b", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67122024-09-23T23:21:38.338ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67132024-09-23T23:21:38.340ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "26d6e321-78f7-4126-b1a3-f6c3a9533efe", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67142024-09-23T23:21:38.340ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67152024-09-23T23:21:38.343ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "73b37025-676a-4f72-af31-fee4f9c4e1b3", "date": "Mon, 23 Sep 2024 23:21:37 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67162024-09-23T23:21:38.343ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67172024-09-23T23:21:38.345ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
67182024-09-23T23:21:38.345ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 542.31141ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
67192024-09-23T23:21:38.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67202024-09-23T23:21:38.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67212024-09-23T23:21:38.388ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
67222024-09-23T23:21:38.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67232024-09-23T23:21:38.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67242024-09-23T23:21:38.397ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67252024-09-23T23:21:38.398ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8e8564df-a465-478b-9c8b-a21cd875fa9b", "content-length": "121", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} })
67262024-09-23T23:21:38.398ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
67272024-09-23T23:21:38.398ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
67282024-09-23T23:21:38.399ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67292024-09-23T23:21:38.399ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67302024-09-23T23:21:38.399ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
67312024-09-23T23:21:38.399ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
67322024-09-23T23:21:38.399ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
67332024-09-23T23:21:38.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67342024-09-23T23:21:38.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67352024-09-23T23:21:38.401ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67362024-09-23T23:21:38.401ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eebd052e-eefc-49f9-8ad1-9f8f747c3e84", "content-length": "2", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} })
67372024-09-23T23:21:38.401ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67382024-09-23T23:21:38.402ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "94b12ce3-8330-43ab-8440-b92d489e6f97", "content-length": "52", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} })
67392024-09-23T23:21:38.402ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
67402024-09-23T23:21:38.402ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67412024-09-23T23:21:38.413ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2183a8e7-ab7e-49ba-9754-37910677b42e", "content-length": "691", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} })
67422024-09-23T23:21:38.413ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67432024-09-23T23:21:38.413ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67442024-09-23T23:21:38.413ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67452024-09-23T23:21:38.414ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 608.783956ms iteration = 20 status = {}
67462024-09-23T23:21:38.503ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9408b8b2-8d86-40f0-8839-3f52b9dd3176", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} })
67472024-09-23T23:21:38.503ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
67482024-09-23T23:21:38.503ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67492024-09-23T23:21:38.508ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "81e41a88-fec8-4ee8-8585-230266a0ad81", "content-length": "667", "date": "Mon, 23 Sep 2024 23:21:38 GMT"} })
67502024-09-23T23:21:38.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67512024-09-23T23:21:38.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67522024-09-23T23:21:38.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67532024-09-23T23:21:38.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67542024-09-23T23:21:38.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67552024-09-23T23:21:38.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67562024-09-23T23:21:38.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67572024-09-23T23:21:38.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67582024-09-23T23:21:38.524ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 718.832274ms iteration = 19 status = {}
67592024-09-23T23:21:39.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a16c680-9a7a-47da-987e-0e87c0a69546 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67602024-09-23T23:21:39.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a16c680-9a7a-47da-987e-0e87c0a69546 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67612024-09-23T23:21:39.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4a16c680-9a7a-47da-987e-0e87c0a69546 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67622024-09-23T23:21:40.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 94889495-875c-4eb8-9fea-85816936de1e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67632024-09-23T23:21:40.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 94889495-875c-4eb8-9fea-85816936de1e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67642024-09-23T23:21:40.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 94889495-875c-4eb8-9fea-85816936de1e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67652024-09-23T23:21:41.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f220fc02-6d27-46ba-b5f7-b7cd60b321d9 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67662024-09-23T23:21:41.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f220fc02-6d27-46ba-b5f7-b7cd60b321d9 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67672024-09-23T23:21:41.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f220fc02-6d27-46ba-b5f7-b7cd60b321d9 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67682024-09-23T23:21:42.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 28a21179-885e-4da1-8d71-083751189652 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67692024-09-23T23:21:42.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 28a21179-885e-4da1-8d71-083751189652 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67702024-09-23T23:21:42.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 28a21179-885e-4da1-8d71-083751189652 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67712024-09-23T23:21:43.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c5c29f4-88b0-4cff-9489-0e35414362f2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67722024-09-23T23:21:43.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c5c29f4-88b0-4cff-9489-0e35414362f2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67732024-09-23T23:21:43.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c5c29f4-88b0-4cff-9489-0e35414362f2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67742024-09-23T23:21:44.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 61aa0259-1bc4-4d14-93e1-266d005261e5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67752024-09-23T23:21:44.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 61aa0259-1bc4-4d14-93e1-266d005261e5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67762024-09-23T23:21:44.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 61aa0259-1bc4-4d14-93e1-266d005261e5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67772024-09-23T23:21:45.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c8cbff0-c72d-4808-99b2-2245e81d8cc2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67782024-09-23T23:21:45.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c8cbff0-c72d-4808-99b2-2245e81d8cc2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67792024-09-23T23:21:45.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c8cbff0-c72d-4808-99b2-2245e81d8cc2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67802024-09-23T23:21:46.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 6a021309-8cd9-4e23-aca8-2f980f8c978d response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
67812024-09-23T23:21:46.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7c63bee0-9c47-4503-87fa-3f968c784b68 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67822024-09-23T23:21:46.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7c63bee0-9c47-4503-87fa-3f968c784b68 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67832024-09-23T23:21:46.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7c63bee0-9c47-4503-87fa-3f968c784b68 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67842024-09-23T23:21:47.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c09912c3-779d-42d7-9b87-6d60eaf63dfd roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67852024-09-23T23:21:47.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c09912c3-779d-42d7-9b87-6d60eaf63dfd resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67862024-09-23T23:21:47.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = c09912c3-779d-42d7-9b87-6d60eaf63dfd response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
67872024-09-23T23:21:47.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
67882024-09-23T23:21:47.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67892024-09-23T23:21:47.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67902024-09-23T23:21:47.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
67912024-09-23T23:21:47.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67922024-09-23T23:21:47.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67932024-09-23T23:21:47.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67942024-09-23T23:21:47.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67952024-09-23T23:21:47.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67962024-09-23T23:21:47.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67972024-09-23T23:21:47.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67982024-09-23T23:21:47.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67992024-09-23T23:21:47.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68002024-09-23T23:21:47.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68012024-09-23T23:21:47.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68022024-09-23T23:21:47.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
68032024-09-23T23:21:47.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68042024-09-23T23:21:47.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68052024-09-23T23:21:47.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
68062024-09-23T23:21:47.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.673355ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
68072024-09-23T23:21:47.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.889993ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68082024-09-23T23:21:48.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e0f869e1-b7ac-4151-bec6-fd37b2a819e5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68092024-09-23T23:21:48.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e0f869e1-b7ac-4151-bec6-fd37b2a819e5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68102024-09-23T23:21:48.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = e0f869e1-b7ac-4151-bec6-fd37b2a819e5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68112024-09-23T23:21:49.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5614b7bb-87a1-4b37-919e-3dc8e244faeb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68122024-09-23T23:21:49.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5614b7bb-87a1-4b37-919e-3dc8e244faeb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68132024-09-23T23:21:49.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5614b7bb-87a1-4b37-919e-3dc8e244faeb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68142024-09-23T23:21:49.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 09b5827b-799e-42a7-8656-85d463acd310 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
68152024-09-23T23:21:49.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 09b5827b-799e-42a7-8656-85d463acd310 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
68162024-09-23T23:21:49.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = 09b5827b-799e-42a7-8656-85d463acd310 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
68172024-09-23T23:21:50.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 16b2c3ef-79e9-4d54-abcf-fca524319d78 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68182024-09-23T23:21:50.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 16b2c3ef-79e9-4d54-abcf-fca524319d78 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68192024-09-23T23:21:50.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 16b2c3ef-79e9-4d54-abcf-fca524319d78 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68202024-09-23T23:21:51.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62d44ac5-9b6f-427a-ba67-ecf1c692e30b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68212024-09-23T23:21:51.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62d44ac5-9b6f-427a-ba67-ecf1c692e30b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68222024-09-23T23:21:51.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 62d44ac5-9b6f-427a-ba67-ecf1c692e30b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68232024-09-23T23:21:52.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b4aa1e46-3f35-48dc-8c89-a4c649279ff0 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68242024-09-23T23:21:52.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b4aa1e46-3f35-48dc-8c89-a4c649279ff0 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68252024-09-23T23:21:52.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b4aa1e46-3f35-48dc-8c89-a4c649279ff0 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68262024-09-23T23:21:53.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 898b0403-b390-489c-9e22-c99f3c75004a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68272024-09-23T23:21:53.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 898b0403-b390-489c-9e22-c99f3c75004a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68282024-09-23T23:21:53.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 898b0403-b390-489c-9e22-c99f3c75004a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68292024-09-23T23:21:54.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f966bef9-5109-48a6-8daf-0e2b22660657 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68302024-09-23T23:21:54.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f966bef9-5109-48a6-8daf-0e2b22660657 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68312024-09-23T23:21:54.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = f966bef9-5109-48a6-8daf-0e2b22660657 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68322024-09-23T23:21:55.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 95e57d2a-509f-4812-8b8a-7ceba7b24543 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68332024-09-23T23:21:55.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 95e57d2a-509f-4812-8b8a-7ceba7b24543 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68342024-09-23T23:21:55.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 95e57d2a-509f-4812-8b8a-7ceba7b24543 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68352024-09-23T23:21:56.282ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 5e521dec-a5e5-4973-aca5-6b6f1e47e49f response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
68362024-09-23T23:21:56.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a03a15ae-96ac-485a-b0a7-84e2f0367335 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68372024-09-23T23:21:56.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a03a15ae-96ac-485a-b0a7-84e2f0367335 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68382024-09-23T23:21:56.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a03a15ae-96ac-485a-b0a7-84e2f0367335 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68392024-09-23T23:21:57.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 74328e33-5e09-4d3d-bb15-8746baf8b6f4 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68402024-09-23T23:21:57.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 74328e33-5e09-4d3d-bb15-8746baf8b6f4 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68412024-09-23T23:21:57.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 74328e33-5e09-4d3d-bb15-8746baf8b6f4 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68422024-09-23T23:21:57.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
68432024-09-23T23:21:57.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68442024-09-23T23:21:57.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68452024-09-23T23:21:57.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
68462024-09-23T23:21:57.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68472024-09-23T23:21:57.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68482024-09-23T23:21:57.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68492024-09-23T23:21:57.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68502024-09-23T23:21:57.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68512024-09-23T23:21:57.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68522024-09-23T23:21:57.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68532024-09-23T23:21:57.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68542024-09-23T23:21:57.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68552024-09-23T23:21:57.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68562024-09-23T23:21:57.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68572024-09-23T23:21:57.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
68582024-09-23T23:21:57.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68592024-09-23T23:21:57.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68602024-09-23T23:21:57.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
68612024-09-23T23:21:57.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.769828ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
68622024-09-23T23:21:57.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.082537ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68632024-09-23T23:21:58.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eb2dd0c0-d63b-409e-a1f4-cb924700b2b6 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68642024-09-23T23:21:58.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eb2dd0c0-d63b-409e-a1f4-cb924700b2b6 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68652024-09-23T23:21:58.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = eb2dd0c0-d63b-409e-a1f4-cb924700b2b6 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68662024-09-23T23:21:59.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 70074134-439d-4056-b8d0-712b299ff0dd roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68672024-09-23T23:21:59.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 70074134-439d-4056-b8d0-712b299ff0dd resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68682024-09-23T23:21:59.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 70074134-439d-4056-b8d0-712b299ff0dd response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68692024-09-23T23:22:00.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 019e1987-0f69-4140-9837-c7ff20b84965 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68702024-09-23T23:22:00.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 019e1987-0f69-4140-9837-c7ff20b84965 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68712024-09-23T23:22:00.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 019e1987-0f69-4140-9837-c7ff20b84965 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68722024-09-23T23:22:01.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 72b46260-66d2-4f78-86b3-d70376221568 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68732024-09-23T23:22:01.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 72b46260-66d2-4f78-86b3-d70376221568 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68742024-09-23T23:22:01.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 72b46260-66d2-4f78-86b3-d70376221568 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68752024-09-23T23:22:02.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cc86b881-2595-48e5-aad7-fbc8d83d2609 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68762024-09-23T23:22:02.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cc86b881-2595-48e5-aad7-fbc8d83d2609 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68772024-09-23T23:22:02.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = cc86b881-2595-48e5-aad7-fbc8d83d2609 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68782024-09-23T23:22:03.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dfc92f94-12f4-4df1-86e3-59ac21e8787e roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68792024-09-23T23:22:03.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dfc92f94-12f4-4df1-86e3-59ac21e8787e resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68802024-09-23T23:22:03.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = dfc92f94-12f4-4df1-86e3-59ac21e8787e response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68812024-09-23T23:22:04.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0302394a-016a-48a8-bf9f-ed2d2aa1a64c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68822024-09-23T23:22:04.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0302394a-016a-48a8-bf9f-ed2d2aa1a64c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68832024-09-23T23:22:04.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 0302394a-016a-48a8-bf9f-ed2d2aa1a64c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68842024-09-23T23:22:05.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e07bf73-49ee-4525-8a83-c4fc7de8bc6a roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68852024-09-23T23:22:05.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e07bf73-49ee-4525-8a83-c4fc7de8bc6a resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68862024-09-23T23:22:05.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e07bf73-49ee-4525-8a83-c4fc7de8bc6a response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68872024-09-23T23:22:06.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1537 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 40acf609-e18e-4c2e-99d8-ce0ff32d1236 response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
68882024-09-23T23:22:06.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ad359ddb-e77d-4114-9d69-4223077674cd roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68892024-09-23T23:22:06.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ad359ddb-e77d-4114-9d69-4223077674cd resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68902024-09-23T23:22:06.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ad359ddb-e77d-4114-9d69-4223077674cd response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
68912024-09-23T23:22:07.803ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
68922024-09-23T23:22:07.803ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68932024-09-23T23:22:07.803ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
68942024-09-23T23:22:07.803ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68952024-09-23T23:22:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68962024-09-23T23:22:07.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68972024-09-23T23:22:07.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
68982024-09-23T23:22:07.804ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
68992024-09-23T23:22:07.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69002024-09-23T23:22:07.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69012024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
69022024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
69032024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69042024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
69052024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69062024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69072024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
69082024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
69092024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
69102024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69112024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
69122024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69132024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69142024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
69152024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69162024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69172024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
69182024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
69192024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69202024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69212024-09-23T23:22:07.805ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
69222024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69232024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69242024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69252024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69262024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69272024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69282024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69292024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69302024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69312024-09-23T23:22:07.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 690205606 } })
69322024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69332024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69342024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69352024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69362024-09-23T23:22:07.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 690353357 } })
69372024-09-23T23:22:07.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69382024-09-23T23:22:07.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
69392024-09-23T23:22:07.807ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
69402024-09-23T23:22:07.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69412024-09-23T23:22:07.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69422024-09-23T23:22:07.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
69432024-09-23T23:22:07.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69442024-09-23T23:22:07.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69452024-09-23T23:22:07.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
69462024-09-23T23:22:07.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69472024-09-23T23:22:07.809ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.776964ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69482024-09-23T23:22:07.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69492024-09-23T23:22:07.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69502024-09-23T23:22:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69512024-09-23T23:22:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69522024-09-23T23:22:07.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69532024-09-23T23:22:07.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69542024-09-23T23:22:07.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69552024-09-23T23:22:07.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69562024-09-23T23:22:07.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69572024-09-23T23:22:07.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69582024-09-23T23:22:07.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69592024-09-23T23:22:07.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69602024-09-23T23:22:07.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69612024-09-23T23:22:07.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69622024-09-23T23:22:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69632024-09-23T23:22:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69642024-09-23T23:22:07.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69652024-09-23T23:22:07.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69662024-09-23T23:22:07.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.926904ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
69672024-09-23T23:22:07.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.173667ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
69682024-09-23T23:22:07.818ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69692024-09-23T23:22:07.818ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69702024-09-23T23:22:07.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69712024-09-23T23:22:07.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69722024-09-23T23:22:07.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69732024-09-23T23:22:07.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69742024-09-23T23:22:07.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69752024-09-23T23:22:07.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69762024-09-23T23:22:07.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69772024-09-23T23:22:07.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69782024-09-23T23:22:07.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a6cfeab5-1bcd-4180-8b80-d27bd607042d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 705975818 } })
69792024-09-23T23:22:07.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
69802024-09-23T23:22:07.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69812024-09-23T23:22:07.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69822024-09-23T23:22:07.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69832024-09-23T23:22:07.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69842024-09-23T23:22:07.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69852024-09-23T23:22:07.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a9e4f7aa-d290-4385-ab53-87543349ecb8 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
69862024-09-23T23:22:07.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a9e4f7aa-d290-4385-ab53-87543349ecb8 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
69872024-09-23T23:22:07.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
69882024-09-23T23:22:07.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69892024-09-23T23:22:07.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69902024-09-23T23:22:07.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a9e4f7aa-d290-4385-ab53-87543349ecb8 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
69912024-09-23T23:22:07.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
69922024-09-23T23:22:07.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.105355ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
69932024-09-23T23:22:07.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69942024-09-23T23:22:07.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69952024-09-23T23:22:07.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69962024-09-23T23:22:07.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69972024-09-23T23:22:07.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69982024-09-23T23:22:07.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69992024-09-23T23:22:07.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70002024-09-23T23:22:07.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70012024-09-23T23:22:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70022024-09-23T23:22:07.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70032024-09-23T23:22:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70042024-09-23T23:22:07.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70052024-09-23T23:22:07.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70062024-09-23T23:22:07.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70072024-09-23T23:22:07.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70082024-09-23T23:22:07.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70092024-09-23T23:22:07.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70102024-09-23T23:22:07.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a6cfeab5-1bcd-4180-8b80-d27bd607042d, lookup_type: ById(a6cfeab5-1bcd-4180-8b80-d27bd607042d) } result = Ok(())
70112024-09-23T23:22:07.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70122024-09-23T23:22:07.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70132024-09-23T23:22:07.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70142024-09-23T23:22:07.860ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70152024-09-23T23:22:07.860ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70162024-09-23T23:22:07.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70172024-09-23T23:22:07.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70182024-09-23T23:22:07.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70192024-09-23T23:22:07.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70202024-09-23T23:22:07.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70212024-09-23T23:22:07.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70222024-09-23T23:22:07.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70232024-09-23T23:22:07.862ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.507671ms iteration = 20 status = 0
70242024-09-23T23:22:07.872ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
70252024-09-23T23:22:07.872ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70262024-09-23T23:22:07.872ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "39d9af8d-a8e5-478f-9512-064e42e8a915", "content-length": "26", "date": "Mon, 23 Sep 2024 23:22:07 GMT"} })
70272024-09-23T23:22:07.872ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70282024-09-23T23:22:07.874ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70292024-09-23T23:22:07.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.860107ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70302024-09-23T23:22:07.880ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
70312024-09-23T23:22:07.880ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70322024-09-23T23:22:07.880ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "80de3ba1-cd05-4c01-a4cb-56de92f30227", "content-length": "26", "date": "Mon, 23 Sep 2024 23:22:07 GMT"} })
70332024-09-23T23:22:07.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70342024-09-23T23:22:07.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70352024-09-23T23:22:07.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.510773ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70362024-09-23T23:22:07.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70372024-09-23T23:22:07.893ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70382024-09-23T23:22:07.893ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.974374ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70392024-09-23T23:22:07.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.032794ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70402024-09-23T23:22:07.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70412024-09-23T23:22:07.898ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70422024-09-23T23:22:07.898ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70432024-09-23T23:22:07.898ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.059371ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70442024-09-23T23:22:07.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 zone_address = fd00:1122:3344:101::2
70452024-09-23T23:22:07.920ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70462024-09-23T23:22:07.921ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a0dd4177-2f75-4008-a04a-7c96636aac72", "content-length": "26", "date": "Mon, 23 Sep 2024 23:22:07 GMT"} })
70472024-09-23T23:22:07.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70482024-09-23T23:22:07.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
70492024-09-23T23:22:07.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.063075ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70502024-09-23T23:22:07.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70512024-09-23T23:22:07.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70522024-09-23T23:22:07.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70532024-09-23T23:22:07.974ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.635193ms iteration = 23 status = {"physical_disks_added":0}
70542024-09-23T23:22:07.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70552024-09-23T23:22:07.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70562024-09-23T23:22:07.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70572024-09-23T23:22:07.978ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70582024-09-23T23:22:07.981ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70592024-09-23T23:22:07.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70602024-09-23T23:22:07.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70612024-09-23T23:22:07.992ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 189.038379ms iteration = 20 status = {}
70622024-09-23T23:22:08.015ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70632024-09-23T23:22:08.015ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83a38f49-d3e8-4922-b535-7c837a709d31", "content-length": "2", "date": "Mon, 23 Sep 2024 23:22:07 GMT"} })
70642024-09-23T23:22:08.018ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70652024-09-23T23:22:08.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70662024-09-23T23:22:08.019ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 216.545256ms iteration = 20 status = null
70672024-09-23T23:22:08.034ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70682024-09-23T23:22:08.034ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f14b62a3-1ae7-4e65-8321-3f025dec4119", "content-length": "372", "date": "Mon, 23 Sep 2024 23:22:07 GMT"} })
70692024-09-23T23:22:08.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70702024-09-23T23:22:08.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70712024-09-23T23:22:08.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70722024-09-23T23:22:08.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70732024-09-23T23:22:08.074ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70742024-09-23T23:22:08.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70752024-09-23T23:22:08.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70762024-09-23T23:22:08.080ZDEBGnexus (BackgroundTasks): client request SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70772024-09-23T23:22:08.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70782024-09-23T23:22:08.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70792024-09-23T23:22:08.121ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 9e7e72a0-7018-4ffe-8bf8-933cbce7a2fa, rack_id: 20416e3d-a221-481f-9784-cbbcea3a72c8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4e81b5e3-1ccd-470e-bc72-1656f9b5351d) } rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
70802024-09-23T23:22:08.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70812024-09-23T23:22:08.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70822024-09-23T23:22:08.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
70832024-09-23T23:22:08.129ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "27269170-f5cf-4e87-8c5c-896f09b4f72c", "content-length": "121", "date": "Mon, 23 Sep 2024 23:22:07 GMT"} })
70842024-09-23T23:22:08.129ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
70852024-09-23T23:22:08.129ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4e81b5e3-1ccd-470e-bc72-1656f9b5351d
70862024-09-23T23:22:08.129ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70872024-09-23T23:22:08.129ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70882024-09-23T23:22:08.129ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
70892024-09-23T23:22:08.129ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 routes = {}
70902024-09-23T23:22:08.129ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8
70912024-09-23T23:22:08.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70922024-09-23T23:22:08.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70932024-09-23T23:22:08.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
70942024-09-23T23:22:08.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "75dc99e5-0c1d-41a9-b10d-2a4a308e993d", "content-length": "2", "date": "Mon, 23 Sep 2024 23:22:07 GMT"} })
70952024-09-23T23:22:08.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
70962024-09-23T23:22:08.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "635891eb-0d05-4a4a-b47e-36f1936f8be4", "content-length": "52", "date": "Mon, 23 Sep 2024 23:22:07 GMT"} })
70972024-09-23T23:22:08.132ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch_location = Switch0
70982024-09-23T23:22:08.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70992024-09-23T23:22:08.175ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1a70650a-54a8-405c-ae19-a57194386fe4", "date": "Mon, 23 Sep 2024 23:22:07 GMT"} })
71002024-09-23T23:22:08.177ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 371.641502ms iteration = 22 status = {}
71012024-09-23T23:22:08.177ZDEBGnexus (BackgroundTasks): client response SledAgent = a6cfeab5-1bcd-4180-8b80-d27bd607042d background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa814ca5-7e46-4340-971c-0c5e2582af45", "content-length": "691", "date": "Mon, 23 Sep 2024 23:22:08 GMT"} })
71022024-09-23T23:22:08.177ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
71032024-09-23T23:22:08.177ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
71042024-09-23T23:22:08.177ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
71052024-09-23T23:22:08.179ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 373.781297ms iteration = 21 status = {}
71062024-09-23T23:22:08.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dc11964c-990a-4452-9b8c-adab2d67b757", "date": "Mon, 23 Sep 2024 23:22:08 GMT"} })
71072024-09-23T23:22:08.269ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 switch = Switch0
71082024-09-23T23:22:08.269ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71092024-09-23T23:22:08.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 20416e3d-a221-481f-9784-cbbcea3a72c8 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7b8824d7-2283-4b14-a2e9-dbf204b59021", "content-length": "667", "date": "Mon, 23 Sep 2024 23:22:08 GMT"} })
71102024-09-23T23:22:08.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71112024-09-23T23:22:08.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71122024-09-23T23:22:08.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71132024-09-23T23:22:08.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71142024-09-23T23:22:08.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71152024-09-23T23:22:08.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71162024-09-23T23:22:08.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71172024-09-23T23:22:08.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71182024-09-23T23:22:08.285ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 480.026232ms iteration = 20 status = {}
71192024-09-23T23:22:08.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ab3b9442-5f05-463c-9397-682e946d9637 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71202024-09-23T23:22:08.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ab3b9442-5f05-463c-9397-682e946d9637 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71212024-09-23T23:22:08.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2686 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = ab3b9442-5f05-463c-9397-682e946d9637 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71222024-09-23T23:22:09.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2f320e70-e3b2-44bc-be6a-087a164c05be roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71232024-09-23T23:22:09.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2f320e70-e3b2-44bc-be6a-087a164c05be resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71242024-09-23T23:22:09.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 2f320e70-e3b2-44bc-be6a-087a164c05be response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71252024-09-23T23:22:10.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b0432c37-d707-4974-aa65-7e1b21d07aeb roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71262024-09-23T23:22:10.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b0432c37-d707-4974-aa65-7e1b21d07aeb resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71272024-09-23T23:22:10.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = b0432c37-d707-4974-aa65-7e1b21d07aeb response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71282024-09-23T23:22:11.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4f529b23-088d-4bbd-af6b-9891b149f0df roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71292024-09-23T23:22:11.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4f529b23-088d-4bbd-af6b-9891b149f0df resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71302024-09-23T23:22:11.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 4f529b23-088d-4bbd-af6b-9891b149f0df response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71312024-09-23T23:22:12.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41c274ca-3ab8-42f9-ac0f-06fdb307e23f roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71322024-09-23T23:22:12.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41c274ca-3ab8-42f9-ac0f-06fdb307e23f resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71332024-09-23T23:22:12.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 41c274ca-3ab8-42f9-ac0f-06fdb307e23f response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71342024-09-23T23:22:13.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 373c3bab-5b55-4f18-819b-86ca244a8913 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71352024-09-23T23:22:13.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 373c3bab-5b55-4f18-819b-86ca244a8913 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71362024-09-23T23:22:13.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 373c3bab-5b55-4f18-819b-86ca244a8913 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71372024-09-23T23:22:14.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7a3b0d73-ae9b-4770-b4fe-38813f0ce8df roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71382024-09-23T23:22:14.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7a3b0d73-ae9b-4770-b4fe-38813f0ce8df resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71392024-09-23T23:22:14.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7a3b0d73-ae9b-4770-b4fe-38813f0ce8df response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71402024-09-23T23:22:16.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68b6144e-aa00-4cc0-8eae-9489f7791249 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71412024-09-23T23:22:16.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68b6144e-aa00-4cc0-8eae-9489f7791249 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71422024-09-23T23:22:16.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 68b6144e-aa00-4cc0-8eae-9489f7791249 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71432024-09-23T23:22:16.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1523 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 8e2d3941-cbfe-460c-9b8e-ae0ba8bcadcc response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
71442024-09-23T23:22:17.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e774c8b-4b6b-4613-acf1-a1f6def540a2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71452024-09-23T23:22:17.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e774c8b-4b6b-4613-acf1-a1f6def540a2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71462024-09-23T23:22:17.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 7e774c8b-4b6b-4613-acf1-a1f6def540a2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71472024-09-23T23:22:17.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
71482024-09-23T23:22:17.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71492024-09-23T23:22:17.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71502024-09-23T23:22:17.805ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
71512024-09-23T23:22:17.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71522024-09-23T23:22:17.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71532024-09-23T23:22:17.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71542024-09-23T23:22:17.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71552024-09-23T23:22:17.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71562024-09-23T23:22:17.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71572024-09-23T23:22:17.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71582024-09-23T23:22:17.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71592024-09-23T23:22:17.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71602024-09-23T23:22:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
71612024-09-23T23:22:17.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71622024-09-23T23:22:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71632024-09-23T23:22:17.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
71642024-09-23T23:22:17.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.266071ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
71652024-09-23T23:22:17.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71662024-09-23T23:22:17.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71672024-09-23T23:22:17.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.900842ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71682024-09-23T23:22:18.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6157301c-cb82-423f-a206-823d1e10706c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71692024-09-23T23:22:18.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6157301c-cb82-423f-a206-823d1e10706c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71702024-09-23T23:22:18.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6157301c-cb82-423f-a206-823d1e10706c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71712024-09-23T23:22:19.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c45c58e-acbb-4a3d-aae3-c656d9a939a5 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71722024-09-23T23:22:19.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c45c58e-acbb-4a3d-aae3-c656d9a939a5 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71732024-09-23T23:22:19.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 3c45c58e-acbb-4a3d-aae3-c656d9a939a5 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71742024-09-23T23:22:19.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = b7b7fe4e-c777-42fc-8ccc-3c04f7a444b6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
71752024-09-23T23:22:19.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = b7b7fe4e-c777-42fc-8ccc-3c04f7a444b6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
71762024-09-23T23:22:19.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:57221 req_id = b7b7fe4e-c777-42fc-8ccc-3c04f7a444b6 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
71772024-09-23T23:22:20.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9b70ce1f-9550-4c6c-833e-fae16b5d0f19 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71782024-09-23T23:22:20.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9b70ce1f-9550-4c6c-833e-fae16b5d0f19 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71792024-09-23T23:22:20.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 9b70ce1f-9550-4c6c-833e-fae16b5d0f19 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71802024-09-23T23:22:21.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 387d681b-6f6f-400e-885e-2f3b307bb8b2 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71812024-09-23T23:22:21.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 387d681b-6f6f-400e-885e-2f3b307bb8b2 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71822024-09-23T23:22:21.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 387d681b-6f6f-400e-885e-2f3b307bb8b2 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71832024-09-23T23:22:22.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 04ac8bc3-be7a-4ad6-9fa7-fe1094bb1158 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71842024-09-23T23:22:22.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 04ac8bc3-be7a-4ad6-9fa7-fe1094bb1158 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71852024-09-23T23:22:22.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 04ac8bc3-be7a-4ad6-9fa7-fe1094bb1158 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71862024-09-23T23:22:23.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = da76bd1c-fd5b-4735-835d-d41fbfb79a3b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71872024-09-23T23:22:23.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = da76bd1c-fd5b-4735-835d-d41fbfb79a3b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71882024-09-23T23:22:23.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = da76bd1c-fd5b-4735-835d-d41fbfb79a3b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71892024-09-23T23:22:24.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 26ad1a58-e15e-4342-8ab1-52ac74737f1c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71902024-09-23T23:22:24.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 26ad1a58-e15e-4342-8ab1-52ac74737f1c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71912024-09-23T23:22:24.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 26ad1a58-e15e-4342-8ab1-52ac74737f1c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71922024-09-23T23:22:25.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a65304e6-125d-4f36-8354-87463ae9641b roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71932024-09-23T23:22:25.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a65304e6-125d-4f36-8354-87463ae9641b resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71942024-09-23T23:22:25.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a65304e6-125d-4f36-8354-87463ae9641b response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71952024-09-23T23:22:26.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6f0bcca5-aa79-4d33-a925-7910e8f408ba roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71962024-09-23T23:22:26.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6f0bcca5-aa79-4d33-a925-7910e8f408ba resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71972024-09-23T23:22:26.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 6f0bcca5-aa79-4d33-a925-7910e8f408ba response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
71982024-09-23T23:22:26.283ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1481 local_addr = [fd00:1122:3344:101::b]:58609 method = GET remote_addr = [fd00:1122:3344:101::d]:40377 req_id = 9fdce304-689b-480c-a5be-2007223500ab response_code = 200 uri = /212442ce-6712-4c6a-beb4-26917e04679b
71992024-09-23T23:22:27.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a5057bd4-6ae7-4b03-bf76-957d49a78746 roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
72002024-09-23T23:22:27.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a5057bd4-6ae7-4b03-bf76-957d49a78746 resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
72012024-09-23T23:22:27.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = a5057bd4-6ae7-4b03-bf76-957d49a78746 response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
72022024-09-23T23:22:27.804ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
72032024-09-23T23:22:27.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72042024-09-23T23:22:27.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72052024-09-23T23:22:27.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72062024-09-23T23:22:27.806ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
72072024-09-23T23:22:27.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72082024-09-23T23:22:27.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72092024-09-23T23:22:27.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72102024-09-23T23:22:27.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72112024-09-23T23:22:27.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72122024-09-23T23:22:27.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72132024-09-23T23:22:27.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72142024-09-23T23:22:27.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.52804ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72152024-09-23T23:22:27.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72162024-09-23T23:22:27.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72172024-09-23T23:22:27.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72182024-09-23T23:22:27.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b95c97b5-62c8-4ae9-8328-0b409a00ae82, lookup_type: ById(b95c97b5-62c8-4ae9-8328-0b409a00ae82) } result = Ok(())
72192024-09-23T23:22:27.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72202024-09-23T23:22:27.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72212024-09-23T23:22:27.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 original_time_created = 2024-09-23 23:12:17.303339 UTC target_id = b95c97b5-62c8-4ae9-8328-0b409a00ae82 time_created = 2024-09-23 23:12:17.303339 UTC
72222024-09-23T23:22:27.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.38109ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b95c97b5-62c8-4ae9-8328-0b409a00ae82","time_created":"2024-09-23T23:12:17.303339Z"}
72232024-09-23T23:22:28.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5c76b392-c29b-4ab3-a521-e88c86a9131c roles = RoleSet { roles: {} } uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
72242024-09-23T23:22:28.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5c76b392-c29b-4ab3-a521-e88c86a9131c resource = Database result = Ok(()) uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d
72252024-09-23T23:22:28.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:51655 req_id = 5c76b392-c29b-4ab3-a521-e88c86a9131c response_code = 200 uri = /probes/a6cfeab5-1bcd-4180-8b80-d27bd607042d